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Abstract 

In  this  paper,  we  present  a  theoretical  framework  for  design  and  analysis  of  distributed  flocking  algorithms. 

Two  cases  of  flocking  in  free-space  and  presence  of  multiple  obstacles  are  considered.  We  present  three  flocking 
algorithms:  two  for  free-flocking  and  one  for  constrained  flocking.  A  comprehensive  analysis  of  the  first  two 
algorithms  is  provided.  We  demonstrate  the  first  algorithm  embodies  all  three  rules  of  Reynolds.  This  is  a  formal 
approach  to  extraction  of  interaction  rules  that  lead  to  the  emergence  of  collective  behavior.  We  show  that  the 
first  algorithm  generically  leads  to  regular  fragmentation,  whereas  the  second  and  third  algorithms  both  lead  to 
flocking.  A  systematic  method  is  provided  for  construction  of  cost  functions  (or  collective  potentials)  for  flocking. 
These  collective  potentials  penalize  deviation  from  a  class  of  lattice-shape  objects  called  a-lattices.  We  use  a 
multi-species  framework  for  construction  of  collective  potentials  that  consist  of  flock-members,  or  a-agents,  and 
virtual  agents  associated  with  a-agents  called  3-  and  7-agents.  We  show  that  the  tracking/migration  problem 
for  flocks  can  be  solved  using  an  algorithm  with  a  peer-to-peer  architecture.  Each  node  (or  macro-agent)  of  this 
peer-to-peer  network  is  the  aggregation  of  all  three  species  of  agents.  The  implication  of  this  fact  is  that  “flocks 
need  no  leaders” .  We  discuss  what  constitutes  flocking  and  provide  a  universal  definition  of  “flocking”  for  particle 
systems  that  has  the  same  role  as  “Lyapunov  stability”  for  nonlinear  dynamical  systems.  By  “universal”,  we 
mean  independent  of  the  method  of  trajectory  generation  for  particles.  Various  simulation  results  are  provided 
that  demonstrate  the  effectiveness  of  our  novel  algorithms  and  analytical  tools.  This  includes  performing  2-D  and 
3-D  flocking,  split/rejoin  maneuver,  and  squeezing  maneuver  for  40  to  150  agents  (e.g.  particles  and  UAVs). 

Keywords:  flocking,  swarming,  distributed  algorithms,  self-organizing  networks,  collective  behavior,  cooperative 
control,  multi-vehicle  systems,  graph  Laplacians,  dynamic  graphs,  mathematical  biology 


1  Introduction 

Flocking  is  a  form  of  collective  behavior  of  large  number  of  interacting  agents  with  a  common  group  objective. 
For  many  decades,  scientists  from  rather  diverse  disciplines  including  animal  behavior,  physics  &  biophysics,  social 
sciences,  and  computer  science  have  been  fascinated  by  the  emergence  of  flocking/swarming/schooling  in  groups  of 
agents  via  local  interactions  [47,  38,  37,  36,  29,  40,  53,  51,  48,  26,  14,  52,  34].  Examples  of  these  agents  include  birds, 
fish,  penguins,  ants,  bees,  and  crowds. 

The  engineering  applications  of  flocking  include  massive  mobile  sensing  in  an  environment;  parallel  and  simulta¬ 
neous  transportation  of  vehicles  or  delivery  of  payloads;  and  performing  military  missions  such  as  reconnaissance, 
surveillance,  and  combat  using  a  cooperative  group  of  Unmanned  Aerial  Vehicles  (UAVs).  Flocking  is  an  example 
of  a  coordinated  task  performed  by  dynamic  agents  over  (visually  invisible)  self-organized  networks  in  nature.  The 
self-organizing  feature  of  flocks/schools  [34]  can  provide  a  deeper  insight  in  design  of  sensor  networks  [5,  28,  13,  8,  1]. 

Particle-based  flocking  is  also  one  of  the  elements  of  3-D  animation  technology  that  has  revolutionized  the  enter¬ 
tainment  industry.  This  success  is  partly  owe  to  the  pioneering  work  of  Reynolds  [40] . 
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In  1986,  Reynolds  introduced  three  heuristic  rules  that  led  to  creation  of  the  first  computer  animation  of  flocking 
[40].  Here  are  three  quotes  from  [40]  that  describe  these  rules: 

1)  “Flock  Centering:  attempt  to  stay  close  to  nearby  flockmates,” 

2)  “Obstacle  Avoidance:  avoid  collisions  with  nearby  flockmates,” 

3)  “Velocity  Matching:  attempt  to  match  velocity  with  nearby  flockmates.” 

Let  us  mention  that  these  rules  are  also  known  as  cohesion,  separation,  and  alignment  rules  in  the  literature.  The 
main  problem  with  implementation  or  analysis  of  the  above  rules  is  that  they  have  broad  interpretations.  The  issue 
of  how  to  interpret  Reynolds  rules  was  resolved  after  publication  of  more  recent  papers  by  Reynolds  [41] ,  [42] . 

Among  the  first  groups  of  physicists  who  studied  flocking  from  a  theoretical  perspective  were  Viscek  et  al.  [53], 
Toner  &  Tu  [51],  and  Shimoyama  et  al.  [48].  The  work  of  Vicsek  et  al.  was  mainly  focused  on  emergence  of  alignment 
(not  flocking)  in  a  particle  system,  whereas  Toner  &  Tu  used  a  continuum  mechanics  approach.  Shimoyama  et  al. 
proposed  a  particle-based  model  that  is  capable  of  describing  various  forms  of  swarming  behaviors  using  a  network 
with  all-to-all  interconnections  (i.e.  a  centralized  algorithm).  Other  continuum  models  of  alignment/swarming  were 
proposed  by  Mogilner  and  Eldstein-Keshet  [25,  26]  with  consideration  of  the  sensing  issues. 

Recently,  there  has  been  a  great  interest  among  control  scientists  in  analysis  of  alignment  phenomenon  and 
consensus  problems.  This  includes  the  alignment  results  in  networks  with  switching  topologies  by  Jadbabaie  et  al. 
[16]  and  Olfati-Saber  &  Murray  [33].  The  results  in  [16]  were  further  extended  to  networks  with  directed  topologies 
by  Moreau  [27]  and  Ren  &  Beard  [39].  The  convergence  analysis  of  a  nonlinear  consensus/ alignment  protocol  was 
first  presented  in  [45].  Helbing  et  al.  [14]  studied  the  escape  panic  phenomenon  in  which  a  crowd  that  is  trapped  in 
a  large  building  (or  arena)  attempts  to  evacuate  that  location  in  case  of  an  emergency.  In  Liu  et  al.  [22],  stability 
analysis  of  one-dimensional  swarms  with  a  fixed  topology  is  studied.  In  [17],  Justh  &  Krishnaprasad  proposed  an 
algorithm  for  swarming  that  requires  all-to-all  interconnections  and  is  only  analyzed  for  the  case  of  two  agents.  Gazi 
&  Passino  [11]  employed  social  potentials  to  study  cohesion  in  swarms  using  a  centralized  mechanism.  Tanner  et  al. 
in  [50]  proposed  a  centralized  algorithm  for  a  particle  system  that  leads  to  irregular  collapse  for  generic  initial  states. 
They  also  proposed  a  distributed  algorithm  that  leads  to  irregular  fragmentation1 .  Fragmentation  and  collapse  are 
two  well-known  pitfalls  of  flocking.  These  phenomena  do  not  constitute  flocking  in  the  sense  described  in  Section  9. 

Some  past  research  with  strong  connections  to  this  paper  include  the  work  by  the  following  researchers:  Fax  & 
Murray  [9]  used  graph  Laplacians  for  multi-vehicle  formation  stabilization;  Mesbahi  [23,  24]  emphasized  the  role  of 
state-dependent  graphs  in  information  networks  (interestingly,  “dynamic  flocks”  turn  out  to  be  examples  of  state- 
dependent  graphs);  Cortes  &  Bullo  [5]  and  Cortes  et  al.  [6]  introduced  distributed  algorithms  for  placement  of  mobile 
sensors  that  appears  to  be  closely  related  to  flocking  in  a  constrained  space;  Rabichini  &  Frazzoli  [43]  proposed  an 
energy-efficient  method  for  determining  the  split  time  in  a  multi-vehicle  rejoin/split  maneuver;  Leonard  &  Fiorelli 
[21]  used  artificial  potentials  for  formation  keeping;  Ogren  et  al.  [28]  use  potential  functions  for  mission  planning 
and  coordination  of  mobile  sensor  networks;  Strogatz  [49]  elucidates  the  features  of  complex  networks  in  physical, 
biological,  and  social  networks  and  suggests  analytical  exploration  of  complex  networks  with  dynamic  topologies; 
Olfati-Saber  &  Murray  [32]  used  potential  functions  induced  by  rigid  graphs  for  formation  control;  and  Khatib  [18] 
and  Rimon  &  Koditschek  [44]  used  artificial  potentials  for  obstacle  avoidance. 

A  number  of  recent  papers  on  flocking/swarming,  [17,  50,  11],  make  a  set  of  assumptions  that  lead  to  algorithms 
with  some  (or  all)  of  the  following  properties: 

a)  The  algorithms  are  centralized  and  require  that  each  agent  interacts  with  every  other  agent. 

b)  The  algorithms  do  not  possess  (environmental)  obstacle  avoidance  capabilities. 

c)  The  algorithms  lead  to  irregular  fragmentation  and/or  collapse. 

cl)  Unbounded  forces  are  used  for  collision  avoidance. 

e)  The  algorithms  do  not  possess  distributed  tracking  (or  migration)  capabilities  for  groups. 

1  By  “irregular  fragmentation” ,  we  mean  disintegration  of  a  flock  into  smaller  groups  combined  with  sever  violation  of  inter-agent 
constraints.  Later,  we  elaborate  on  features  of  fragmentation  and  collapse  and  their  differences  with  flocking. 
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Centralized  algorithms  for  flocking/swarming  are  neither  scalable  in  terms  of  computational  and  communication  costs 
(i.e.  the  total  number  of  links),  nor  feasible  from  a  biological  perspective  because  the  sensing  range  of  an  individual 
agent  is  limited. 

To  the  best  of  our  knowledge,  there  are  only  two  classes  of  scalable  flocking  algorithms  that  do  not  possess 
properties  a)  through  e)  and  successfully  lead  to  creation  of  flocking  in  presence  of  obstacles.  Namely,  the  work  by 
Chang  et  al.  [4]  that  uses  gyroscopic  forces  for  collision  avoidance  and  the  work  by  Olfati-Saber  [31]  (summarized 
in  [46])  which  uses  multi-species  collective  potential  functions  for  both  imposing  inter-agent  constraints  and  obstacle 
avoidance.  So  far,  there  are  no  analytical  results  that  relate  the  algorithm  in  [4]  to  flocking.  In  [31]  some  analytical 
results  such  as  asymptotic  alignment  and  energy  dissipation  are  established.  The  analysis  presented  in  [31]  and  some 
other  existing  works  on  flocking  are  far  from  complete.  In  particular,  the  existence  of  a  spatial  order  in  flocks/schools 
has  never  been  established.  In  this  paper,  we  attempt  to  bridge  some  of  these  theoretical  gaps. 

From  the  perspective  of  control  theory,  complex  systems,  and  animal  behavior,  there  are  a  number  of  fundamental 
questions  that  have  inspired  this  work: 

1.  How  do  we  design  scalable  flocking  algorithms  and  guarantee  their  convergence? 

2.  What  does  cohesion  mean  for  groups  and  how  is  it  achieved  in  a  distributed  way? 

3.  What  are  the  stability  analysis  problems  related  to  flocking? 

4.  What  types  of  order  exist  in  flocks? 

5.  How  do  agents  in  flocks  perform  obstacle  avoidance? 

6.  How  do  flocks  perform  split /rejoin  maneuvers  or  pass  through  narrow  spaces? 

7.  How  do  flocks  migrate  from  point  A  to  B?  do  they  need  any  leaders? 

8.  What  is  a  flock?  and  what  constitutes  flocking? 

We  address  questions  1-5  in  the  context  of  flocking  in  free-space  and  questions  6  and  7  as  we  discuss  flocking  in 
presence  of  environmental  obstacles.  Finally,  at  the  end  of  the  paper,  we  discuss  what  constitutes  flocking.  We  hope 
that  our  analysis  sheds  light  on  mechanisms  of  cooperation  and  emergence  of  collective  behavior  in  groups. 

Let  us  refer  to  a  particle/agent  in  a  group  with  the  objective  of  performing  flocking  as  an  a-agent.  We  introduce 
three  scalable  flocking  algorithms  for  a-agents.  Our  first  algorithm  is  a  gradient-based  algorithm  equipped  with  a 
velocity  consensus  protocol.  We  demonstrate  that  the  first  algorithm  embodies  all  three  rules  of  Reynolds.  It  is  also 
demonstrated  that  this  algorithm  leads  to  regular  fragmentation  rather  than  flocking  for  generic  initial  states.  The 
analysis  of  the  first  algorithm  is  very  useful  for  clarifying  the  features  of  the  regular  fragmentation  phenomenon.  The 
second  algorithm  (or  Algorithm  2)  is  the  main  flocking  algorithm  for  moving  in  a  free  m-space.  This  algorithm  has 
an  additional  term  represented  by  a  y-agent  that  takes  the  group  objective  into  account.  In  the  process  of  analyzing 
Algorithm  2,  we  pose  two  conjectures  that  are  crucial  in  explaining  the  spatial  order  of  flocks  and  self-assembly  of  a 
connected  network  of  mobile  agents. 

The  third  algorithm  (or  Algorithm  3)  has  obstacle  avoidance  capabilities.  We  represent  the  effects  of  obstacles 
via  virtual  agents  called  /3-agents.  These  agents  are  kinematic  and  move  on  the  boundary  of  the  obstacles.  A  multi¬ 
species  collective  potential  is  then  formed  that  is  used  for  both  design  and  analysis  of  the  third  flocking  algorithm. 
We  demonstrate  that  the  tracking  problem  for  flocks  can  be  solved  using  a  distributed  algorithm  with  a  peer-to-peer 
architecture.  This  analytically  confirms  a  widely  accepted  opinion  by  animal  behavior  scientists  that  “schools  need 
no  leaders”  [47]. 

The  main  contribution  of  this  paper  is  to  provide  a  theoretical  and  computational  framework  for  creation  and 
analysis  of  scalable  flocking  algorithms  in  Rm  in  presence  (or  lack)  of  environmental  obstacles.  Two  important 
pitfalls  of  flocking  are  identified  and  avoided.  The  tracking  problem  for  groups  is  addressed.  A  universal  definition  of 
flocking  is  provided  for  particle  systems  that  is  similar  to  the  notion  of  “Lyapunov  stability”  for  nonlinear  systems. 
The  definition  is  “universal”  in  the  sense  that  it  does  not  depend  on  the  method  of  trajectory  generation  for  particles. 
A  verification  test  for  flocking  is  proposed  based  on  plotting  four  curves  obtained  from  the  trajectory  of  particles. 
We  provide  several  simulation  results  for  40  to  150  agents  that  successfully  perform  2-D  flocking,  3-D  flocking,  2-D 
regular  fragmentation,  split/rejoin  maneuver,  and  squeezing  maneuver  in  a  distributed  manner. 

An  outline  of  the  paper  is  as  follows:  Some  background  on  graphs,  nets,  a-lattices,  algebraic  graph  theory, 
consensus  problems,  collective  potentials  are  presented  in  Section  2.  Two  distributed  flocking  algorithms  for  moving 
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in  free-space  are  provided  in  Section  3.  Collective  dynamics  of  flocks  and  a  decomposition  lemma  are  stated  in 
Section  4.  Our  main  results  on  analysis  of  the  first  two  algorithms  are  presented  in  Section  5.  The  relation  between 
Algorithm  1  and  Reynolds  rules  are  established  in  Section  6.  The  third  algorithm  with  obstacle  avoidance  capabilities 
is  presented  in  Section  7.  Extensive  simulation  results  are  provided  in  Section  8.  In  Section  9,  we  elaborate  on  what 
constitutes  flocking  and  give  a  universal  definition  of  flocking.  Finally,  concluding  remarks  are  made  in  Section  10. 


2  Preliminaries 

The  theoretical  framework  presented  in  this  paper  for  both  creation  and  stability  analysis  of  flocking  behavior  relies 
on  some  basic  concepts  in  graph  theory  [2,  7,  15],  algebraic  graph  theory  [12],  spatially  induced  graphs  [31],  and 
consensus  problems  [45,  33]  that  are  discussed  in  the  following. 

2.1  Graphs  and  Nets 

A  graph  G  is  a  pair  (V,  £)  that  consists  of  a  set  of  vertices  V  =  {1,2 ...  ,n}  and  a  set  of  edges  £  C  V  x  V.  The 
quantities  |V|  and  |£|  are,  respectively,  called  order  and  size  of  the  graph.  In  the  context  of  networked  dynamic 
systems,  |£|  is  referred  to  as  the  communication  complexity  of  a  network  with  information  flow  G  [19]. 

The  adjacency  matrix  A  =  [a,;;y-]  of  a  graph  is  a  matrix  with  nonzero  elements  satisfying  the  property  at3  ^ 
0  (i,  j)  G  £ .  The  graph  is  called  weighted  whenever  the  elements  of  its  adjacency  matrix  are  other  than  just 

0-1  elements.  Here,  we  mostly  use  weighted  graphs  with  position-dependent  adjacency  elements.  A  graph  G  is  called 
undirected  iff  the  adjacency  matrix  A  is  symmetric  (or  AT  =  A).  The  set  of  neighbors  of  node  i  is  defined  by 

Nt  =  { j  €  V  :  ay  ?  0}  =  {j  G  V  :  (i,j)  G  £}.  (1) 

Note  1.  Throughout  the  paper,  for  simplicity  of  notation,  we  assume  an  =  0  for  all  i  (or  the  graphs  have  no  loops 
meaning  (i,i)  ^  £). 

Let  qt  G  Rm  denote  the  position  of  node  i  for  all  i  G  V.  The  vector  q  =  col(gi, . . . ,  qn)  G  Q  =  Rm"  is  called  the 
configuration  of  all  nodes  of  the  graph.  A  framework  (or  structure)  is  a  pair  (G,  q)  that  consists  of  a  graph  and  the 
configuration  of  its  nodes. 


Figure  1:  An  agent  and  its  neighbors  in  a  spherical  neighborhood. 

Consider  a  group  of  dynamic  agents  (or  particles)  with  equation  of  motion 

r  *  =  Pi ,  (2) 

[  Pi  =  Ui, 

where  qi,Pi,Ui  G  Km  (e.g.  m  =  2,3)  and  !  G  V.  The  benefit  of  using  particle-based  models  of  flocks  compared  to 
continuum  models  is  that  one  cannot  take  inter-agent  sensing,  communication,  and  computational  issues  for  granted. 

Let  r  >  0  denote  the  interaction  range  between  two  agents.  An  open  ball  with  radius  r  (see  Fig.  1)  determines 
the  set  of  spatial  neighbors  of  agent  i  that  is  denoted  by 

Ni  =  {j  e  v  :  hi  -gill  <  r}  (3) 
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where  ||  •  ||  is  the  Euclidean  norm  in  Rm.  Given  an  interaction  range  r  >  0,  a  spatially  induced  graph  G(q)  =  (V,  £(g)) 
can  be  specified  by  V  and  the  set  of  edges 

£(?)  =  {(bj)  e  V  x  V  :  \\qj  -gi||  <  r,i^j}  (4) 

that  clearly  depends  on  q.  We  refer  to  the  graph  G(g)  as  a  net  and  to  the  structure  (G(g),  g)  as  a  framenet. 

The  topology  of  a  wireless  sensor  network  with  a  radio  range  r  is  an  example  of  a  net  [1].  If  the  interaction  range 
of  all  agents  is  the  same,  the  net  G(q)  becomes  an  undirected  graph.  A  net  G(g)  is  generically  a  digraph  under  either 
of  the  following  assumptions:  1)  the  spherical  neighborhoods  of  agents  do  not  have  the  same  radius,  or  2)  every  agent 
uses  a  conic  neighborhood  to  determine  its  neighbors  [40,  31].  In  this  paper,  all  nets  are  undirected  graphs. 


2.2  a-Lattices  and  Quasi  cc-Lattices 

One  of  our  objectives  is  to  design  flocking  protocols  with  capabilities  that  allow  a  group  of  dynamic  agents  to  maintain 
identical  inter-agent  distances  over  a  net  G(g).  This  motivates  us  to  consider  the  following  set  of  inter-agent  algebraic 
constraints: 

II g^  —  g* II  =  d,  VjeW(g)  (5) 

A  configuration  q  that  is  the  solution  of  the  set  of  constraints  in  (5)  frequently  appears  in  this  paper.  Hence,  we  find 
it  convenient  to  define  these  solutions  as  lattice-type  objects. 

Definition  1.  (a-lattice)  An  a-lattice  is  a  configuration  q  satisfying  the  set  of  constraints  in  (5).  We  refer  to  d  and 
k  =  r/d  as  the  scale  and  ratio  of  an  a-lattice,  respectively. 


Keep  in  mind  that  the  net  induced  by  an  a-lattice  is  not  required  to  be  connected.  Furthermore,  all  edges  of  a 
structure  (G(g),g)  that  is  induced  by  an  a-lattice  have  the  same  length.  Some  common  examples  of  2-D  and  3-D 
a-lattices  (with  interaction  range  r  =  nd  so  that  k  =  1  +  e  and  0  <  e  -C  1)  include  square  lattices,  hexagonal  lattices 
and  the  vertex  sets  of  regular  polygons  and  platonic  solids.  Fig.  2  illustrates  other  examples  of  a-lattices. 


(c) 


Figure  2:  Examples  of  a-lattices  and  quasi  a-lattices:  (a)  a  2-D  a-lattice,  (b)  a  3-D  a-lattice,  and  (c)  a  2-D  quasi 
a-lattice  with  n  =  100  nodes. 


We  also  need  to  use  a  slightly  deformed  versions  of  a-lattices  that  are  defined  as  follows: 

Definition  2.  (quasi  a-lattice)  A  quasi  a-lattice  is  a  configuration  q  satisfying  the  following  set  of  inequality  con¬ 
straints: 

-5  <  \\qj  -  qi\\  -  d  <  5,  V(i,j)  e  £(g)  (6) 

where  5  -C  d  is  the  edge-length  uncertainty,  d  is  the  scale,  and  n  =  r/d  is  the  ratio  of  the  quasi  a-lattice. 

Fig.  2  (c)  illustrates  a  quasi  a-lattice  that  is  computed  numerically  using  the  second  flocking  algorithm  (or  protocol 
(26)). 
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2.3  Deviation  Energy  of  Conformations 

To  measure  the  degree  in  which  a  configuration  q  differs  from  an  a-lattice,  we  use  the  following  deviation  energy 

1  " 

E(g)  =  (|g(q)|  +  i)  S  £  Mlgj  ~  g«ll  ~  d)  (?) 

where  if>(z)  =  z2  is  called  a  pairwise  potential  (note  that  other  scalar  potentials  can  be  used  as  well).  The  deviation 
energy  can  be  viewed  as  a  nonsmooth  potential  function  for  a  system  of  n  particles.  Interestingly,  a-lattices  are 
global  minima  of  this  potential  function  and  achieve  the  minimum  value  of  zero.  For  a  quasi  a-lattice  q  with  an 
edge-length  uncertainty  of  S,  the  deviation  energy  is  given  by 


E(q)< 


\m\ 

TOI +  1 


62  <  62 


e2d 2,  £  <C  1 


which  means  quasi  a-lattices  are  low-energy  conformations  of  n  points.  The  order  of  magnitude  of  the  deviation 
energy  of  the  quasi  a-lattice  in  Fig.  2  (c)  is  10-3  (for  d  =  7  and  k  =  1.2). 


2.4  cr-Norms  and  Bump  Functions 

The  a-norm  of  a  vector  is  a  map  Rm  — >  R>o  ( not  a  norm)  defined  as 


with  a  parameter  e  >  0  and  a  gradient  <Je(z)  =  VH-zH^.  given  by 


z 

1  +  t\\z\\a 


(8) 

(9) 


The  parameter  e  of  the  tr-norm  remains  fixed  throughout  the  paper.  One  might  wonder  why  do  we  even  need  to 
define  a  new  norm.  The  map  ||^||<7  is  differentiable  everywhere,  but  ||z||  is  not  differentiable  at  z  =  0.  Later,  this 
property  of  cr-norms  is  used  for  construction  of  smooth  collective  potential  functions  for  groups  of  particles. 

Remark  1.  The  function  \\zWa  was  effectively  used  in  [32]  as  a  penalty  function  in  construction  of  potential  function 
for  formation  control.  This  led  to  design  and  analysis  of  a  distributed  algorithm  for  formation  stabilization  with 
bounded  control. 

Remark  2.  The  map  cre(z)  is  a  uniformly  bounded  function  satisfying  the  following  properties:  i)  zTae(z)  >  0,  Vz  yf  0, 
ii)  ||<7e(y)||  <  1  /y/e  for  all  0,  and  iii)  (a:  -  y)T(ai(x)  -  >  0,Va:  yf  y. 

A  bump  function  is  a  scalar  function  ph{z)  that  smoothly  varies  between  0  and  1.  Here,  we  use  bump  functions  for 
construction  of  smooth  potential  functions  with  finite  cut-offs  and  smooth  adjacency  matrices.  One  possible  choice 
is  the  following  bump  function  introduced  in  [46] 


Ph(z) 


i[l  +  cos(7rfe=W)], 


z  €  [0,  h) 
z  G  [h,  1] 
otherwise. 


(10) 


where  h  G  (0, 1).  One  can  show  that  Ph(z)  is  a  C1 -smooth  function  with  the  property  that  p'h(z)  =  0  over  the  interval 
[l,oo)  and  |p)j(.z)|  is  uniformly  bounded  in  z.  Using  this  bump  function,  we  can  define  a  spatial  adjacency  matrix 
A(q)  via  its  elements  by 

aij{Q )  =  Ph{\\qj  ~~  II  cr/^ot)  €  [0,  1],  j  7^  i  (11) 

where  ra  =  Hrjlo-  and  au(q)  =  0  for  all  i  and  q.  For  h  =  1,  Ph{z)  is  an  indicator  function  that  is  equal  to  1  over  the 
interval  [0, 1)  and  0,  otherwise.  The  use  of  an  indicator  bump  function  leads  to  a  net  with  0-1  position-dependent 
adjacency  elements. 
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2.5  Collective  Potential  Functions 


The  collective  potential  function  V(q)  of  a  group  of  agents  is  a  non-negative  function  V  :  R7Tm  — >  K>0  with  the 
property  that  any  solution  of  the  set  of  algebraic  constraints  in  (5)  is  “closely  related  to”  a  local  minima  of  V (q)  and 
vice  versa.  The  sense  in  which  these  two  quantities  are  closely  related  is  measured  using  the  deviation  energy  that 
acts  as  a  distance  function.  In  this  paper,  a  collective  potential  is  a  smooth  version  of  a  deviation  energy  function 
with  a  scalar  pairwise  potential  that  has  a  finite  cut-off.  This  means  that  there  exists  a  finite  interaction  range 
r  >  0  such  that  ip' (z)  =  0 ,  Vz  >  r.  This  feature  turns  out  to  be  the  fundamental  source  of  scalability  of  our  flocking 
algorithms. 

Remark  3.  Generalized  Lennard- Jones  functions  and  exponentially  vanishing  maps  do  not  have  finite  cut-offs  and 
are  inadequate  for  our  purpose  without  any  modifications.  A  common  approach  to  create  a  pairwise  potential  with  a 
finite  cut-off  is  “soft  cutting”  in  which  a  pairwise  potential  is  multiplied  by  a  bump  function  (as  in  [31]).  Here,  we  use 
an  alternative  approach  by  softly  cutting  action  functions  and  then  using  their  integrals  as  pairwise  potentials.  This 
way  the  derivative  of  the  bump  function  never  appears  in  the  action  function  (i.e.  derivative  of  a  pairwise  potential), 
and  thereby  a  negative  bump  in  the  action  function  near  z  =  r  is  avoided. 

Let  ip{z)  :  R>o  — >  R>o  be  an  attractive/repulsive  pairwise  potential  with  a  global  minimum  at  z  =  d  and  a  finite 
cut-off  at  r.  Then,  the  following  function 

<p(?)  =  ~  Qi\\  ~d)  (12) 

* 

is  a  collective  potential  that  is  not  differentiable  at  singular  configurations  in  which  two  distinct  nodes  coincide,  or 
q%  =  q:j .  To  resolve  this  problem,  we  use  the  set  of  algebraic  constraints  in  (5)  that  are  rewritten  in  terms  of  u-norms 
as 

hj  -  filler  =  da,  Mj  G  Ni(q)  (13) 

where  da  =  ||  o? ||  .  These  constraints  induce  a  smooth  collective  potential  function  in  the  form: 

v(l)  =  \j2^2^a(\\qj  ~  qi\\a)  (14) 

* 

where  ipa(z)  is  a  smooth  pairwise  attractive/repulsive  potential  (defined  in  equation  (16))  with  a  finite  cut-off  at 
ra  —  1 1  r  1 1  <7  and  a  global  minimum  at  z  =  da. 

To  construct  a  smooth  pairwise  potential  with  finite  cut-off,  we  integrate  an  action  function  cpa(z)  that  vanishes 
for  all  z  >  ra.  Define  this  action  function  as 

(pa{z)  =  ph(z/ra)(p(z  —  da)  ,  , 

<j>{z)  =  |  [(a  +  6)01(2  +  c)  +  (a  —  b)} 

where  <71(2)  =  z/y/l  +  z 2  and  <f>(z)  is  an  uneven  sigmoidal  function  with  parameters  that  satisfy  0  <  a  <  6, 
c  =  |a  —  b\/\J \ab  to  guarantee  </>(0)  =  0.  The  pairwise  attractive/repulsive  potential  ipa(z)  in  (14)  is  defined  as 

ipa{z)  =  [  (pa(s)ds.  (16) 

J  da 

Functions  <j>a{z)  and  ipa(z)  are  depicted  in  Fig.  3. 

2.6  Graph  Laplacians  and  Velocity  Matching 

Graph  Laplacians  are  very  useful  in  analysis  of  velocity  matching/ alignment.  Consider  a  graph  G  of  order  n  with 
adjacency  matrix  A  =  [«*,■] .  The  degree  matrix  of  G  is  a  diagonal  matrix  A  =  A  (A)  with  diagonal  elements  1  aij 
that  are  row-sums  of  A.  The  scalar  graph  Laplacian  L  =  \ltj\  is  an  n  x  n  matrix  associated  with  graph  G  that  is 
defined  as 

L  =  A(A)  -  A.  (17) 

Laplacian  matrix  L  always  has  a  right  eigenvector  of  l.„  =  (1, . . . ,  1)T  associated  with  eigenvalue  Ai  =  0.  The 
following  lemma  summarizes  the  basic  properties  of  graph  Laplacians: 
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(a)  (b) 

Figure  3:  The  action  and  potential  functions  with  finite  cut-offs:  (a)  cf>a(z )  and  (b)  f)a(z). 


Lemma  1.  Let  G  =  (V,£)  be  an  undirected  graph  of  order  n  with  a  non-negative  adjacency  matrix  A  =  AT .  Then, 
the  following  statements  hold: 

i)  L  is  a  positive  semidefinite  matrix  that  satisfies  the  following  sum-of-squares  (SOS)  property: 

ztLz= ^  Y,  aij(zj  -  Zi)2,  ztR";  (18) 

(*b)e£ 

ii)  The  graph  G  has  c  >  1  connected  components  iff  rank(L)  =  n  —  c.  Particularly,  G  is  connected  iff  rank(L)  = 
n  —  1; 

Hi)  Let  G  be  a  connected  graph,  then 

Az(i)  =  2T£  Z~w  >  0  (19) 

Proof.  All  three  results  are  well-known  in  the  field  of  algebraic  graph  theory  and  their  proofs  can  be  found  in  Godsil 
and  Royle  [12].  □ 

The  quantity  X-2(L)  is  known  as  algebraic  connectivity  of  a  graph  [10].  In  [33],  it  was  shown  that  the  speed  of 
convergence  of  a  linear  consensus  protocol  (defined  in  (22))  is  equal  to  A2  >  0.  This  consensus  protocol  will  appear 
as  a  velocity  matching  term  in  all  flocking  algorithms  that  will  be  presented  in  this  paper.  Particularly,  we  use 
m-dimensional  graph  Laplacians 2  defined  by 

L  =  Li g>lm,  (20) 

where  (g)  denotes  the  Kronecker  product.  This  multi-dimensional  Laplacian  satisfies  the  following  SOS  property: 

zTLz=l-  Y  ^Wzj-Zif,  zeR”  (21) 

(ij)e£ 

where  z  =  col(zi,  Z2,  ■  ■  . ,  zn)  and  zt  £  Rm  for  all  i.  Matrix  L  can  be  viewed  as  the  Laplacian  of  a  graph  with 
adjacency  matrix  A  =  A  8>  lm.  There  is  an  important  relationship  between  m-dimensional  Laplacians  and  velocity 
matching  in  flocks.  Let  G  be  an  undirected  graph  with  adjacency  matrix  A  =  [ Aif\  and  suppose  each  agent  applies 
the  following  input 

Ui  =  Y  ~Pi)-  (22) 

jeNi 

This  is  the  multi- variable  version  of  the  consensus  protocol  in  [33].  Define  a  velocity  mismatch  function  as  K  = 
\  Si  ll^ill2  with  Vi  =  pi  —  p  and  note  that  p  =  A  SiP*  is  invariant  in  time.  Then  K  =  —  t  aij\\vj  —  Vi  ||2  <  0 

and  Ui  acts  as  a  damping  force.  Under  the  condition  of  connectivity  of  G ,  one  can  show  that  pi  (t)  — >  a  as  t  — >  00  for 
all  i  (see  [33]  for  further  details). 

2  In  the  area  of  coordination  of  multi- vehicle  systems,  m-dimensional  Laplacians  were  first  used  by  Fax  &;  Murray  [9]  for  formation 
stabilization. 
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3  Flocking  Algorithms  for  Free-Space 

In  this  section,  we  present  a  set  of  distributed  algorithms  for  flocking  in  free-space,  or  free-flocking.  (The  flocking 
algorithms  with  obstacle  avoidance  capabilities  are  presented  in  Section  7.)  We  refer  to  a  physical  agent  with  equation 
of  motion  g)  =  Ui  as  an  a-agent.  a-agents  correspond  to  birds,  or  members  of  a  flock.  This  terminology  is  used  to 
distinguish  between  physical  agents  and  certain  virtual  agents  that  will  be  introduced  later.  Informally  speaking,  an 
a-agent  has  a  tendency  to  stay  at  a  distance  d  >  0  from  all  of  its  neighboring  a-agents  (this  is  the  reason  behind  the 
name  “a-lattice”).  In  free-flocking,  each  a-agent  applies  a  control  input  that  consists  of  three  terms: 

ui  =  ft+fi+ri  (23) 

where  ff  =  —VqiV(q)  is  a  gradient-based  term,  ff  is  a  velocity  consensus/alignment  term  that  acts  as  a  damping 
force,  and  ff  is  a  navigational  feedback  due  to  a  group  objective.  Examples  of  a  group  objective  are  moving  towards 
a  destination  (migration)  or  flocking  out  of  a  crowded  space  with  few  exits.  We  propose  two  distributed  algorithms 
that  can  be  used  for  creation  of  flocking  motion  in  Rm  (dimensions  1,  2,  3  are  of  great  interest): 

Algorithm  1:  iq  =  it“  with 


Uj  )  bo:  (  1 1  (lj  /  1 1  rr  j  VI /  /  T  f  '  aij{q)(Pj  Pi] 

j€Ni  jGNi 

where  riy  is  a  vector  along  the  line  connecting  g,;  to  qj  and  is  given  by 


(24) 


n ij  =  ae(qj  -  qf) 


dj  -  Qi 

\A  +  e|kj  ~<h\\2 


(25) 


and  0  <  e  <  1  is  a  fixed  parameter  of  the  cr-norm.  Algorithm  1  has  no  navigational  feedback  and  is  known  as  the 
(a,  a)  flocking  protocol  [31]  because  it  states  the  interaction  rules  between  two  a-agents. 


Algorithm  2:  m  =  itf  +  u] ,  or 

ui  =  -  qi\\a)n,j  +  ^2  aij(q)(Pj  -  Pi)  +  fifaiiPi) 

jeNi  jeNi 


(26) 


where  u]  is  the  navigational  feedback  that  is  given  by 

U1  ’■=  fi(Qi,Pi,Qr,Pr)  =  ~C\{qi  -  qr)  -  c2{pi  -  Pr ),  Ci,C2  >  0.  (27) 

The  pair  ( qr,Pr )  G  Rm  x  Rm  is  the  state  of  a  7-agent.  A  7- agent  is  dynamic/static  agent  that  represents  a  group 
objective.  Let  ( qdiPd )  be  a  fixed  pair  of  to- vectors  that  denote  the  initial  position  and  velocity  of  a  7-agent.  A 
dynamic  7- agent  has  the  following  model 

(  ^  =  PI)  x  (28) 

{  Pr  =  Jr{qr,Pr), 

with  (<jv(0),Pr(0))  =  ( q<uPd )•  A  static  'y-agent  has  a  fixed  state  that  is  equal  to  ( qd,Pd )  for  all  time. 

Note  2.  For  those  readers  who  are  familiar  with  the  meaning  and  application  of  7-agents  in  [31],  7-agents  in  this 
paper  have  a  completely  different  meaning  and  function  compared  to  those  described  in  [31]  for  obstacle  avoidance. 

The  design  of  fr(qnPr)  for  a  dynamic  7-agent  is  part  of  tracking  control  design  for  a  group  of  agents.  For  example, 
the  choice  of  fr  =  0  leads  to  a  7-agent  that  moves  along  a  straight  line  with  a  desired  velocity  pd- 

During  the  analysis  of  protocols  (24)  and  (26),  we  will  see  that  despite  the  similarities  between  certain  terms  in 
these  protocols,  the  collective  behavior  of  a  group  of  agents  that  use  Algorithm  1  is  drastically  different,  than  a  group 
of  agents  applying  Algorithm  2. 

Remark  4.  We  will  demonstrate  that  protocol  (24)  unifies  all  three  rides  of  Reynolds  in  a  single  equation  [30].  This 
is  not  the  result  of  applying  a  gradient-based  algorithm.  It  is  due  to  the  fact  that  the  gradient-based  term  of  the 
protocol  can  be  expressed  in  terms  of  position-dependent  stress  elements  of  a  graph.  A  detailed  discussion  of  this 
topic  is  presented  in  Section  6. 
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Remark  5.  It  turns  out  that  protocol  (24)  leads  to  flocking  behavior  only  for  a  very  restricted  set  of  initial  states. 
For  generic  set  of  initial  states  and  large  number  of  agents  (e.g.  n  >  10),  protocol  (24)  most  likely  fails  to  produce 
flocking  behavior  and  instead  leads  to  regular  fragmentation  as  illustrated  in  Fig.  4.  Fragmentation  is  a  pitfall  of 
flocking.  In  contrast,  protocol  (26)  never  leads  to  fragmentation.  As  a  result,  only  Algorithm  2  is  truly  a  flocking 
algorithm.  However,  analysis  of  Algorithm  1  provides  a  valuable  insight  into  the  analysis  of  Algorithm  2. 


Figure  4:  The  fragmentation  phenomenon. 


4  Collective  Dynamics 

The  collective  dynamics  of  a  group  of  a-agents  applying  protocol  (26)  (or  (24))  is  in  the  form: 


collective  dynamics: 


q  =  p 

P  =  -VV(g)  -  L(q)p+  f^(q,p,qr,pr) 


(29) 


where  V{q)  is  a  smooth  collective  potential  function  given  in  (14)  and  L{q )  is  the  m-dimensional  Laplacian  of  the 
net  G(q)  with  a  position-dependent  adjacency  matrix  A(q)  =  [a, j ((])].  Note  that  for  Algorithm  1,  f1  =  0. 

The  first  expected  result  is  that  with  /7  =  0,  system  (29)  is  a  dissipative  particle  system  with  Hamiltonian 


H{q,p)  =  V(q)  +  Y l 


\Pi\ 


(30) 


This  is  due  to  H  =  —pTL(q)p  <  0  and  the  fact  that  the  multi-dimensional  graph  Laplacian  L(q)  is  a  positive 
semidefinite  matrix  for  all  q. 

The  key  in  stability  analysis  of  collective  dynamics  is  employing  a  correct  coordinate  system  that  allows  the  use 
of  LaSalle’s  invariance  principle.  The  naive  approach  is  to  use  H(q,p)  in  the  (g,p)-coordinates.  The  reason  such  an 
approach  does  not  work  (for  most  cases  of  interest)  is  that  one  cannot  establish  the  boundedness  of  solutions.  During 
fragmentation,  the  solution  cannot  remain  bounded.  Therefore,  we  propose  the  use  of  a  moving  frame  to  analyze 
the  stability  of  flocking  motion  as  suggested  in  [31]. 

Consider  a  moving  fame  that  is  centered  at  qc — the  center  of  mass  (CM)  of  all  particles.  Let  Ave(,z)  =  ]C"=1  zi 

denote  the  average  of  the  zfs  with  z  =  col(2i, . . . ,  zn).  Let  qc  =  Ave(g)  and  pc  =  Ave(p)  denote  the  position  and 
velocity  of  the  origin  of  the  moving  frame.  Then  qc{t)  =  pc{t )  and  pc(t)  =  A ve(u(t)). 

Our  objective  is  to  separate  the  analysis  of  the  motion  of  the  center  of  the  group  with  respect  to  the  reference 
frame  from  the  collective  motion  of  the  particles  in  the  moving  frame.  The  position  and  velocity  of  agent  i  in  the 
moving  frame  is  given  by 

Xi  =  qt-  qc, 

Vi  =  Pi-Pc- 

The  relative  positions  and  velocities  remain  the  same  in  the  moving  frame,  i.e.  Xj  —  Xi  =  qj  —  qi  and  v:j  —Vi=  pj  —pi- 
Thus,  V(q)  =  V(x)  and  VF(g)  =  VV(x).  The  (a,  a)  protocol  in  the  moving  frame  can  be  expressed  as 


(31) 


E 

jeNi 


r)ni: 


E< 

jeNi 


i(x)(Vj  -  Vi) 
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with  a,ij{x)  =  Ph(\\xj  —  Xi\\a/ra).  Our  first  result  is  a  decomposition  lemma  that  is  the  basis  for  posing  a  structural 
stability  problem  for  “dynamic  flocks”  (i.e.  a  dynamic  network  with  a  topology  that  is  a  connected  net  and  nodes 
that  are  particles). 

Lemma  2.  (decomposition)  Suppose  that  the  navigational  feedback  f-y(q,p)  is  linear,  i.e.  there  exists  a  decomposition 
of  fry  (q,p)  in  the  following  form 

f~t(q,P,qr,Pr)  =  g{x,v )  +  ln  <g>  h(qc,pc,qr,pr).  (32) 

Then,  the  collective  dynamics  of  a  group  of  agents  applying  protocol  (26)  (or  (24),)  can  be  decomposed  as  n  second- 
order  systems  in  the  moving  frame 

f  —  v 

structural  dynamics:  <  .  _T,,  .  $ ,  .  .  .  (33) 

y  \  v  =  -W(x)-L(x)v  +  g(x,v)  y  ’ 

and  one  second-order  system  in  the  reference  frame 

translational  dynamics:  <  ,c  ^c,  .  (34) 

i  Pc  =  h(qc,pc,  qr,pr) 

where 

g(x,v)  =  -cix-c2v  ,  , 

h(qc,pc,qr,Pr)  =  —Ci(qc  —  qr)  —  c2(pc  —  pr) 
and  ( qr,Pr )  is  the  state  of  the  7- agent . 

Proof.  See  Section  A.l  in  Appendix  A.  □ 

A  discussion  of  the  effects  of  using  a  nonlinear  navigational  feedback  is  presented  in  Appendix  B.  In  this  case,  it 
turns  out  that  the  structural  and  translational  dynamics  are  coupled. 


5  Stability  Analysis  of  Flocking  in  Free-Space  (Main  Results) 


According  to  the  decomposition  lemma,  we  are  now  at  the  position  to  define  stable  flocking  motion  as  the  combination 
of  the  following  forms  of  stability  properties: 

1.  Stability  of  certain  equilibria  of  the  structural  dynamics. 


2.  Stability  of  a  desired  equilibrium  of  the  translational  dynamics. 

The  challenging  part  of  stability  analysis  for  a  flocking  algorithm  is  to  establish  part  1.  Investigation  of  part  2  is  far 
simpler  than  part  1.  For  example,  in  the  case  of  Algorithm  1,  qc  =  0  and  thus  the  center  of  the  group  moves  along 
a  straight  line.  Of  course,  this  is  not  the  case  for  Algorithm  2  where  the  group  objective  determines  the  aggregate 
behavior  of  the  flock  as  a  whole. 

As  far  as  animal  behavior  is  concerned,  the  translational  dynamics  of  a  flock  does  not  necessarily  have  to  possess 
an  equilibrium  point  that  is  stable  or  asymptotically  stable.  A  flock  of  birds  could  circle  an  area  over  and  over  or 
move  in  a  erratic  and  unpredictable  manner.  However,  from  an  engineering  stand  point,  an  overall  control  over  the 
collective  behavior  of  a  flock  is  highly  desired.  In  fact,  the  very  reason  to  perform  flocking  for  UAVs  is  to  steer  a 
group  of  vehicles  from  point  A  to  B  as  a  whole.  Thus,  in  robotics  or  engineering  applications,  performing  the  second 
task  becomes  very  crucial.  As  a  consequence,  flocking  protocols  such  as  Algorithm  2  that  account  for  the  group 
objective  are  beneficial  for  engineering  applications. 

The  significant  differences  in  the  effects  of  Algorithms  1  and  2  are  due  to  the  considerable  differences  in  their 
respective  structural  dynamics.  Given  Algorithm  1,  one  obtains  the  following  structural  dynamics: 


Si  : 


x 

i) 


v 

-VV(x)  -  L( x)v 


(36) 


with  a  positive  semidefinite  Laplacian  matrix  L(x).  In  comparison,  the  structural  dynamics  of  a  group  of  agents 
applying  Algorithm  2  is  in  the  form 


y  .  f  X  =  V 
2  '  \  v  =  —\7U\(x)  -  D(x)v 


(37) 
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where  U\  ( x )  is  called  the  aggregate  potential  function  and  is  defined  by 

U\(x)  =  V(x)  +  AJ(x). 


(38) 


The  map  J(x)  =  \  lla'j||2  is  the  moment  of  inertia  of  all  particles  and  A  =  C\  >  0  is  a  parameter  of  the 
navigational  feedback.  Moreover,  the  damping  matrix  D(x)  =  C2lm  +  L(x)  is  a  positive  definite  matrix  with  C2  >  0. 

Before  presenting  the  stability  analysis  of  flocking  behavior  under  Algorithms  1  and  2,  we  need  to  define  the 
structural  Hamiltonians  of  systems  Hi  and  E2  as  follows: 

H(x,v)  =  V(x)  +  K(v),  .  . 

H\(x,v)  =  Ux(x)  +  K(v), 

where  K(v)  =  \  Yh%  IK’-t  ||2  is  the  velocity  mismatch  function,  or  the  kinetic  energy  of  the  particle  system  in  the  moving 
frame.  We  also  need  to  define  what  we  mean  by  “cohesion  of  a  group”  and  “flocks”. 

Definition  3.  (a  cohesive  group)  Let  (</(•)> £>(•))  :  ^  l— >  K171"  x  ]Rmn  be  the  state  trajectory  of  a  group  of  dynamic 
agents  over  the  time  interval  [to ,  f /] .  We  say  the  group  is  cohesive  for  all  t  £  [to,  t/]  if  there  exists  a  ball  of  radius  R  >  0 
centered  at  qc(t)  =  A ve(q(t))  that  contains  all  the  agents  for  all  time  t  €  [to,t/],  i.e.  3 R  >  0  :  ||x(f)||  <  R,  Vt  €  [to,f/]. 
In  general,  let  ||x||q  =  (xTQx)i  be  the  weighted  norm  of  x  with  a  positive  definite  matrix  Q.  Then,  cohesion  of  a 
group  can  be  easily  generalized  to  the  boundedness  of  position  of  all  agents  in  an  ellipsoid  by  1 1  x  (t)  1 1  q  <  R,  Vt  €  [to ,  t/] . 


Note  3.  In  this  paper,  cohesion  is  a  property  of  the  trajectory  of  a  group  of  agents  (as  in  Definition  3)  and  “cohesion 
rule”  is  another  common  name  of  the  “flock  centering”  rule  of  Reynolds.  One  should  not  take  one  for  another  by 
mistake. 

Definition  4.  (flocks,  quasi-flocks,  &  dynamic  flocks)  The  configuration  q  of  a  set  of  points  V  is  called  a  flock  with 
interaction  range  r  if  the  net  G(q)  is  connected,  q  is  called  a  quasi-flock  if  G(q)  has  a  giant  component  (i.e.  a 
connected  subgraph  with  relatively  large  number  of  nodes).  A  group  of  a-agents  are  called  a  dynamic  flock  over  the 
time  interval  [tofif)  if  at  every  moment  t  £  [to,tf),  they  are  a  flock. 

The  aforementioned  definitions  formalize  some  of  the  commonly  used  terms  such  as  “flocks”  and  “cohesion  of 
flocks” .  Furthermore,  according  to  the  following  theorem,  these  notions  are  essential  in  explaining  why  flocking 
emerges  as  a  form  of  collective  behavior  of  a-agents. 

Theorem  1.  Consider  a  group  of  a-agents  applying  protocol  (24)  (Algorithm  1 )  with  structural  dynamics  Hi  (defined 
in  (36)/  Let  f lc  =  {(x,u)  :  H(x,v)  <  c}  be  a  level-set  of  the  Hamiltonian  H(x,v)  of  Hi  such  that  for  any  solution 
starting  in  Llc,  the  group  of  agents  is  a  cohesive  dynamic  flock  for  all  t  >  0.  Then,  the  following  statements  hold: 

i)  Almost  every  solution  of  the  structural  dynamics  converges  to  an  equilibrium  (x*,0)  with  a  configuration  x* 
that  is  an  a -lattice. 

ii)  The  velocity  of  all  agents  asymptotically  match  in  the  reference  frame, 
in)  Given  c  <  c*  =  ^>a(0),  no  inter-agent,  collisions  occur  for  all  t  >  0. 

Proof.  Any  solution  ( q(t),p(t ))  of  the  collective  dynamics  of  a-agents  applying  protocol  (24)  is  uniquely  mapped  to 
a  solution  (x(t),v(t))  of  the  structural  dynamics  Hi.  We  have 

H{x,v)  =  -vtL{x)v  =  ^2  aij(x)\\vj  ~  vi\\2  <  0  (40) 

(i,j)e£(x) 

which  means  the  structural  energy  H(x,v )  is  monotonically  decreasing  for  all  t  >  0.  In  addition,  H(x(t),v(t))  <  c 
for  all  t  >  0  that  implies  Qc  is  an  invariant  set.  This  guarantees  that  the  velocity  mismatch  is  upper  bounded  by  c 
because  of 

K(v(t))  <  H(x(t),v(t))  <  c,  Vt  >  0. 
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By  assumption,  for  any  solution  starting  in  fic,  the  group  is  cohesive  in  all  time  t  >  0.  Hence,  there  exists  an  R  >  0 
such  that  ||a;(f)||  <  R,  Vf  >  0.  The  combination  of  boundedness  of  velocity  mismatch  and  group  cohesion  guarantees 
boundedness  of  solutions  of  starting  in  Qc.  This  fact  is  the  result  of  the  following  inequality: 

||(a:(£),t>(t))||2  :=  \\x(t)\\2  +  |Kf)||2  <R2  +  2c=:C  (41) 


where  C  >  0  is  a  constant. 

From  LaSalle’s  invariance  principle,  all  the  solutions  of  Hi  starting  in  fic  converge  to  the  largest  invariant  set  in 
E  =  {(x,  v)  €  :  H  =  0}.  However,  since  the  group  of  a-agents  constitutes  a  dynamic  flock  for  all  t  >  0,  G(q(t)) 

is  a  connected  graph  for  all  t>  0.  Thus,  based  on  equation  (40),  we  conclude  that  the  velocities  of  all  agents  match 
in  the  moving  frame,  or  iq  =  . . .  =  vn.  But  vi  =  0,  therefore,  =  0  for  all  i  (or  v  =  0).  This  means  that  the 
velocity  of  all  agents  asymptotically  match  in  the  reference  frame,  or  p\  =  P2  =  =  Pm  which  proves  part  ii). 

Moreover,  the  configuration  x  asymptotically  converges  to  a  fixed  configuration  x*  that  is  an  exterma  of  V(x),  i.e. 
\/V{x*)  =  0. 

Since  any  solution  of  the  system  starting  at  certain  equilibria  such  as  local  maxima  or  saddle  points  remain  in 
those  equilibria  for  all  time,  not  all  solutions  of  the  system  converge  to  a  local  minima.  However,  anything  but  a 
local  minima  is  an  unstable  equilibria  (a  blanket  assumption).  Thus,  almost  every  solution  of  the  system  converges 
to  an  equilibrium  (a:*,0)  where  x*  is  a  local  minima  of  V(x).  According  to  Theorem  2,  every  local  minima  of  V{x)  is 
an  a-lattice.  Therefore,  x*  is  an  a-lattice  and  asymptotically  all  inter-agent  distances  between  neighboring  a-agents 
become  equal  to  d.  This  finishes  the  proof  of  parts  i)  and  ii). 

We  prove  part  iii)  by  contradiction.  Assume  there  exists  a  time  t  =  t\  >  0  so  that  two  distinct  agents  k.  I  collide, 
or  qk(t i)  =  qi{t\).  For  all  t  >  0,  we  have 

r(«M)  =  5  EH  '‘I’aXWQj  <t) 

i  jjti 

=  Ipaihktt)  -  ftWIU)  +  \  H  'Paihj  -di\\a) 

iGV\{k,l}  jeV\{i,k,l} 

>  i’aihkit)  -  qi(t)\\a). 

Hence,  V{q{t i))  >  ^>Q(0)  =:  c*.  But  the  velocity  mismatch  is  a  non-negative  quantity  and  fic  is  an  invariant  level-set 
of  H.  This  gives 

V(q(t))  <  H(x(t),v(t))  —  K(v(t))  <  H(x(t),v(t))  <  c  <  c*,Vt  >  0 

which  is  in  contradiction  with  an  earlier  inequality  V(q(ti))  >  c*.  Therefore,  no  two  agents  collide  at  any  time 
t  >  0.  □ 

The  following  theorem  provides  a  geometric  characterization  of  the  set  of  local  minima  of  V (q) .  This  result  is 
used  in  the  proof  of  part  i)  of  Theorem  1. 

Theorem  2.  Every  local  minima  ofV(q)  is  an  a-lattice  and  vice  versa. 

Proof.  Define  an  e -neighborhood  of  q  as 

K(q)  =  w  e  Kmn  :  U  -  Qi\\  <  e,  Vi  G  V},  (42) 

where  q'  =  col(q[,  q'2,  ■  ■ . ,  q'n).  A  configuration  q*  is  called  a  local  minima  of  V (q)  if  there  exists  an  e-neighborhood 
Afe(q)  of  q*  such  that  V(q)  >  V(q*)  for  all  q  G  A fe{q*)-  Keep  in  mind  that  V(q)  remains  invariant  under  rotation 
and  translation  of  all  qf  s,  therefore  it  does  not  have  any  isolated  local  minima. 

The  collective  potential  function  V{q)  can  be  decomposed  into  two  terms:  a  graph-induced  potential  function  by 
the  net  G(q)  and  an  additional  term  that  is  an  integer  factor  of  ho  =  '</>Q(rQ),  i.e. 

V  ( q )  =  VG(q)  +  k(q)h0  (43) 

where 

Vg(q)  =  5E(i,j)e£(g)V’a(||^-gi||a),  (u) 

Kd)  =  |(n(n-  1)  -  |£(<?)|)  €  1=  {0,1,2,. ..  ,n(n-  1)}. 
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Notice  that  k(q)  is  an  integer  that  is  directly  determined  by  the  number  of  edges  of  the  net  G(q)  (( i,j )  and  (j,i) 
with  i  j  count  as  two  edges).  The  higher  the  size  of  the  net  G(q),  the  lower  the  value  of  k(q).  Let  Qk  denote  the 
set  of  configurations  that  induce  nets  with  \£{q)\  =  n(n  —  1)  —  2 k  edges  for  a  fixed  specification  (d,  r ).  Observe  that 
^k^o^Qk  —  Rmra.  For  a  fixed  k  £  X,  we  have 

V  (q)  =  VG(q )  +  kh0  >  kho  (45) 

for  all  q  £  Qk-  Any  configuration  q*  that  achieves  the  equality  in  (45)  is  a  local  minima  of  V(q)  and  satisfies 
Va(q*)  =  0.  On  the  other  hand,  ipa{z)  takes  the  value  zero  only  at  z  =  da,  hence  the  configuration  q*  satisfies 

h*~q*h  =  da  =►  \\q*  —  q*\\  =  d 

for  all  j  £  Ni(q).  This  means  that  q*  is  an  a-lattice.  The  proof  of  the  converse  is  rather  similar  and  is  omitted.  □ 
The  following  result  provides  a  global  stability  analysis  of  Algorithm  2  that  is  useful  for  creation  of  flocking 
motion  for  generic  sets  of  initial  conditions.  In  comparison  to  Theorem  1,  no  assumptions  regarding  group  cohesion 
or  connectivity  of  the  net  are  made  in  the  following  theorem: 

Theorem  3.  Consider  a  group  of  a- agents  applying  protocol  (26)  (Algorithm  2)  with  ci,c2  >  0  and  structural 
dynamics  S2  (defined  in  (37)/  Assume  that  the  initial  velocity  mismatch  AT(u(0))  and  inertia  J(x( 0))  are  finite. 
Then,  the  following  statements  hold: 

i)  The  group  of  agents  remain  cohesive  for  all  t  >  0. 

ii)  Almost  every  solution  of  S2  asymptotically  converges  to  an  equilibrium  point  (x/0)  where  xx  is  a  local  minima 
ofU\(x). 

Hi)  The  velocity  of  all  agents  asymptotically  match  in  the  reference  frame. 

iv)  Assume  the  initial  structural  energy  of  the  particle  system  is  less  than  ( k  +  1  )c*  with  c*  =  ipa( 0)  and  k  £  Z  +. 
Then,  at  most  k  distinct  pairs  of  a-agents  could  possibly  collide  (k  =  0  guarantees  a  collision-free  motion). 

Proof.  First,  note  that  the  particle  system  with  structural  dynamics  S2  and  Hamiltonian  Hx(x,v)  =  Ux(x)  +  K (v) 
is  a  strictly  dissipative  particle  system  in  the  moving  frame  because  it  satisfies 

Hx(x,  v )  =  — uT(c2/m  +  L(x))v  =  -c2(uTu)  -  vtL(x)v  <0,  Vu  /  0. 

Hence,  the  structural  energy  H\(x,v)  is  monotonically  decreasing  for  all  (x,v)  and 

H\ (x(t),v(t))  <  H0  :=  Hx(x(0),v(0))  <  oo. 

The  finiteness  of  H0  =  P(a:(0))  +  XJ(x(0))  +  K(v( 0))  follows  from  the  assumption  that  the  collective  potential,  the 
inertia,  and  the  velocity  mismatch  are  all  initially  finite.  Thus,  for  all  t  >  0,  we  have 

Ux(x(t))  <  H0,  K(v(t))  <  Ho. 

But  U\(x)  =  V(x)  +  (fxTx  with  A  >  0  and  V(x)  >0  for  all  x,  therefore 

xT(t)x(t)  <  V<  >  0. 

A 

This  guarantees  the  cohesion  of  the  group  of  a-agents  for  all  t  >  0  because  the  position  of  all  agents  remains  in  a 
ball  of  radius  R  =  \j2Ho/\  centered  at  qc.  This  cohesion  property  together  with  boundedness  of  velocity  mismatch, 
or  K(v(t ))  <  H0,  guarantees  boundedness  of  solutions  of  the  structural  dynamics  S2.  To  see  this,  let  z  =  col(x,  u), 
then 

||2(t)||2  =  xT(t)x{t)  +  vT(t)v(t)  <  2(y  +  1)H0  =■  C( A)  <  oo. 

A 

Part  ii)  follows  from  LaSalle’s  invariance  principle.  Keep  in  mind  that  H\(x ,v)  =  0  implies  v  =  0.  Thus,  similar  to 
the  argument  in  the  proof  of  Theorem  1,  almost  every  solution  of  the  particle  system  asymptotically  converges  to  an 
equilibrium  point  z*x  =  {x*x,  0)  where  x*x  is  a  local  minima  of  the  aggregate  potential  function  Ux(x). 
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Part  iii)  follows  from  the  fact  that  v  asymptotically  vanishes.  Thus,  the  velocities  of  all  agents  asymptotically 
match  in  the  reference  frame. 

To  prove  part  iv),  suppose  H0  <  (k  +  1  )c*  and  there  are  more  than  k  distinct  pairs  of  agents  that  collide  at  a 
given  time  t,-\  >  0.  Hence,  there  must  be  at  least  k  +  1  distinct  pairs  of  agents  that  collide  at  time  t\.  This  implies 
the  collective  potential  of  the  particle  system  at  time  t  =  t\  is  at  least  (k  +  l)V’a(O).  However,  we  have 

H0  =  V(®(0))  +  AJ(x(0))  +  A>(0))  >  V (x(0)  >  (k  +  l)V'a(O). 

This  contradicts  the  assumption  that  Hq  <  (k  +  l)c*.  Hence,  no  more  than  k  distinct  pairs  of  agents  can  possibly 
collide  at  any  time  t  >  0.  Finally,  with  k  =  0,  no  two  agents  ever  collide.  □ 

Theorem  3  establishes  some  critical  properties  of  collective  behavior  of  a  group  of  agents  applying  Algorithm  2 
including  cohesion,  convergence,  asymptotic  velocity  matching,  and  collision-avoidance.  But,  unless  one  provides  a 
geometric  characterization  of  local  minima  of  U\(q)  for  relatively  small  A  >  0,  it  is  not  possible  to  establish  that 
the  limiting  conformation  is  “closely  related”  to  an  a-lattice.  I  would  like  to  pose  two  conjectures  that  establish 
this  close  relationship  between  geometric  and  graph  theoretic  properties  of  any  local  minima  of  U\(q)  and  features 
of  flocks: 

Conjecture  1.  (connectivity)  Any  local  minima  q J  of  U\(q)  for  A  >  0  is  a  flock  with  interaction  range  r. 

Conjecture  1  can  be  equivalently  stated  as  follows:  Let  U\{q)  =  V(q)  +  A  J(x)  be  an  aggregate  potential  function, 
then  any  local  minima  of  U\(q)  with  A  >  0  induces  a  connected  net  G(q)f).  The  next  conjecture  states  geometric 
properties  of  q). 

Conjecture  2.  (quasi  a-lattice)  Let  U\(q)  =  V(q)  +  A  J(x)  be  an  aggregate  potential  function  with  parameter  A  >  0. 
For  any  fixed  n,  d,r  satisfying  r/d  =  1  +  e  (e  C  lj,  there  exists  a  X*  <C  1  so  that  1)  any  local  minima  q J  of  U\(q) 
with  A  €  (0,  A*)  is  a  quasi  a-lattice  with  ratio  k  =  1  +  £  and  2)  q ^  induces  a  planar  graph  (G(q)(),  qf)  in  dimensions 
m  =  1,2,  3. 

Proof/disproof  of  both  conjectures  is  the  subject  of  ongoing  research.  Now,  we  are  ready  to  present  a  more 
enhanced  version  of  Theorem  3  with  both  geometric  and  graph  theoretic  relations  to  flocking. 

Theorem  4.  Consider  a  group  of  a- agents  applying  protocol  (26)  (Algorithm  2)  with  Ci,C2  >  0  and  structural 
dynamics  £2.  Assume  the  initial  structural  energy  is  finite  and  the  interaction  range  satisfies  r/d  =l  +  e  (eClj.  If 
conjectures  1  and  2  hold,  then  there  exists  a  A*  <  1  such  that  with  A  £  (0,  A*),  almost  every  solution  o/£ 2  converges 
to  an  equilibrium  point  (x*x,  0)  where  x*x  is  a  flock  with  low  deviation  energy. 

Proof.  The  proof  follows  from  part  ii)  of  Theorem  3  and  Conjectures  1  and  2.  □ 

In  simulation  results  of  flocking  (see  Section  8),  the  author  observed  that  during  flocking,  the  framenets  induced 
by  the  trajectory  of  a-agents  were  planar  graphs3.  The  following  theorem,  analytically  establishes  this  planarity 
property  as  well  as  a  bound  on  the  computational  complexity  of  nets  induced  by  a-lattices. 

Theorem  5.  Let  q  be  an  a-lattice  of  scale  d  >  0  and  ratio  k  >  1  with  n  nodes  at  distinct  positions.  Then 

i)  The  structure  ( G(q),q )  induced  by  q  is  a  planar  graph  in  dimensions  m  =  2,3. 

ii)  The  net  G(q)  has  at  most  3n  —  6  links  in  dimension  2. 

iii)  The  net  G(q)  induced  by  an  a-lattice  with  n  >  m+1  nodes  cannot  be  a  complete  graph  in  dimensions  m  =  1,2, 3. 

Proof.  See  Section  A. 2  in  Appendix  A.  □ 

Based  on  part  iii)  of  Theorem  5,  an  interesting  property  of  a-lattices  is  that  their  spatially  induced  graphs  are 
never  complete  graphs  if  the  lattice  has  a  medium  to  large  number  of  nodes  ( n  >  4  nodes  in  dimension  2) .  This  fact 
discourages  the  use  of  all-to-all  networks  (or  centralized  algorithms)  for  creation  of  flocking. 

Remark  6.  Part  ii)  of  Theorem  5  states  that  the  total  number  of  the  edges  of  a  2-D  flock  that  is  an  a-lattice  is  linear 
in  n.  This  is  in  agreement  with  our  policy  of  lowering  the  communication  and  computational  cost  in  multi-vehicle 
systems  by  using  scalable  algorithms. 

3 A  planar  graph  is  a  structure  in  which  no  two  edges  intersect  each  other  anywhere  other  than  their  endpoints. 
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Remark  7.  According  to  Theorem  5,  the  planarity  of  graphs  induced  by  a-lattices  imposes  a  restriction  on  maximum 
ratio  of  the  interaction  range  r  to  desired  distance  d  >  0.  For  example,  a  cubic  lattice  q  in  dimension  m  is  a  valid 
a-lattice  with  ratio  K  =  l  +  eif0<e<  y/m.  Otherwise,  two  nodes  that  are  on  opposite  sides  of  the  diagonal 
of  a  hypercube  become  neighbors  and  this  invalidates  q  as  an  a-lattice.  Since  each  node  can  no  longer  be  equally 
distanced  from  all  of  its  neighbors.  This  is  schematically  shown  in  Figure  5  for  dimension  to  =  2. 


Figure  5:  The  effect  of  ratio  ft  on  validity  of  a  square  lattice  as  an  a-lattice:  (a)  k  =  1  +  e  <  y/2  (valid)  and  (b) 
ft  =  y/2  +  e  (invalid) . 


6  Algorithm  1  vs.  Reynolds  Rules 


In  this  section,  we  demonstrate  that  Algorithm  1  (or  the  (a,  a)  protocol  in  (24))  embodies  extended  forms  of  all 
three  rules  of  Reynolds  in  a  single  equation  [30] .  In  [40] ,  the  flock  centering  rule  of  Reynolds  is  further  clarified  by 
saying  that  “each  agent  moves  towards  the  center  of  its  neighboring  agents”.  The  term  “center”  means  center  of 
mass  (CM).  This  does  not  clarify  when  rules  1  and  2  of  Reynolds  need  to  be  applied  at  a  given  situation.  This  issue 
is  resolved  during  our  attempt  to  extract  Reynolds  rules  from  Algorithm  1. 

The  key  tool  in  our  analysis  are  stress  elements  of  a  graph  [46] .  Let  us  define  the  stress  elements  associated  with 
edge  (■ i,j )  of  the  net  G(q)  as 


Sij{q) 


4* a  ( 1 1  Qj  jtjjjr) 

1+^\\Qj  —  filler  ’ 


(i,j)  G  £{q). 


(46) 


The  stress  elements  between  non-neighboring  agents  are  defined  to  be  zero.  The  (a,  a)  flocking  protocol  can  be 
expressed  in  terms  of  stress  and  adjacency  elements  as  follows: 


K  =  ~Qi)+  ~  Pi)  =  uz+  uim- 

jeNi(q)  jeNi(q) 


(47) 


From  the  above  equation,  all  three  rules  of  Reynolds  follow.  The  second  term  represents  the  velocity  matching  rule 
(or  rule  3)  and  the  first  term  embodies  both  the  flock  centering  and  separation  rules  (rules  1  &  2) . 

To  demonstrate  this  fact,  we  consider  two  cases:  i)  Sfq)  ^  0  and  ii)  Sz(q)  =  0  where  Sfq)  =  ^2jeNi  Sij(q)  turns 
out  to  be  the  “quantitative  measure”  that  determines  whether  rule  1  or  rule  2  need  to  be  applied  at  a  given  state. 
In  case  i),  we  have 

-  di)  =  Si(q){qi  -  {qf})  (48) 

where  (qf)  is  the  weighted  average  of  the  position  of  the  neighbors  of  agent  i,  i.e. 


^jGNi  Sij(Cl)<lj 

'YhjeNi  Sij(<l ) 


(49) 


Clearly,  the  weights  are  stress  elements  that  depend  on  the  relative  position  of  neighboring  agents.  The  weighted 
center  (qf)  is  undefined  for  Sl(q)  =  0.  This  is  why  we  need  to  analyze  case  ii). 

Before  discussing  case  ii),  let  us  mention  that  each  agent  follows  the  following  rules: 
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action  vfj  of  agent  i  = 


move  towards  the  weighted  center  of  the  neighbors,  St ( q)  >  0 

move  away  from  the  weighted  center  of  the  neighbors,  S,  ( q)  <  0 


(50) 


Here,  “weighted  center”  means  {qf)  (defined  in  (49)).  As  a  byproduct,  we  obtain  a  clear  guideline  that  allows  us  to 
determine  whether  the  “separation  rule”  or  the  “cohesion  rule”  is  applicable  in  state  ( q,p ). 

It  remains  to  analyze  case  ii)  with  S)(g)  =  0.  Let  us  define  the  sets  of  friends  of  agent  i.  Define  the  set  of  positive, 
negative,  and  neutral  friends  of  agent  i,  respectively,  as 


F+  =  {j  G  Ni(q )  :  Sij(q)  >  0},  Fi  =  {j  G  Ni(q)  :  si:j{q)  <  0},  F°  =  {j  G  N^q)  :  sij(q)  =  0}.  (51) 

Clearly,  {F+{q),  F~(q),  Ff(q)}  is  a  partition  of  Ni(q)  and  Ff(q)  is  always  a  nonempty  set  because  i  G  Ff  (i.e.  each 
agent  is  its  own  neutral  friend).  Let  us  define  the  sums  of  stress  elements  between  agent  i  and  its  positive  and 
negative  friends  as 

SH<l)=  Y  sb(9)<?b  sr(<l)  =  Y  siM)<lr 

jeF+(q )  jeF~(q) 


We  have  Si(q )  =  S+  (q)  +  St  (q)  =  0,  thus 


Y  Sij(q)qj  -  Si(q)qi 

j£Ni(q) 

Y  SiM)<H+  Y 

j£F+  jeF~ 

st  (q)(<li)+  +  (q){qi)~ 


or 

u9i  =  s+  (q)  (( qi)+  -  {q%)~)  (52) 

where  (qi)+  and  (g,)-  denote  the  positive  and  negative  weighted  centers  of  neighbors  of  agent  i  defined  by 

/  N+  T,jeF+(q)Sij(<l)(lj  YhjeFr(q) 

\<li)  =  ^  - T  73“  J  m  =  sr  - „  73  ■  (53) 

2-ijeF+(q) 

According  to  (52),  given  an  agent  with  S,  ( q)  =  0,  a  force  parallel  to  the  line  connecting  the  weighted  centers  of 
negative  and  positive  friends  of  agent  i  is  applied  to  the  agent.  This  extra  rule  can  be  informally  stated  as  “stay 
away  from  the  center  of  your  negative  friends  and  move  towards  the  center  of  your  positive  friends  We  call  this 
the  signed  friendship  rule.  Needless  to  mention  that  this  rule  does  not  follow  from  any  rules  of  Reynolds. 

At  any  node  of  an  a-lattice  S, ( q)  =  0  and  all  friends  of  an  a-agent  are  neutral  friends.  According  to  Theorem  1, 
all  agents  applying  the  (a,  a)  protocol  asymptotically  become  neutral  friends  of  their  neighbors  (modulo  technical 
conditions)  and  form  a  stress-free  structure. 


7  Flocking  with  Obstacle  Avoidance 

In  this  section,  we  present  a  distributed  flocking  algorithm  with  multiple  obstacle-avoidance  capability.  The  main 
idea  is  to  use  agent-based  representation  of  all  nearby  (active)  obstacles  by  creating  a  new  species  of  agents  called 
/3-agents.  A  (3-agent  is  a  kinematic  agent  that  is  induced  by  an  a-agent  whenever  the  a-agent  is  in  close  proximity  of 
an  obstacle.  In  the  following,  we  formally  define  the  notion  of  a  /3-agent  and  specify  the  interaction  protocol  between 
an  a-agent  and  a  /3-agent. 

We  restrict  our  study  to  obstacles  that  are  connected  convex  regions  in  Rm  with  boundaries  that  are  smooth 
manifolds.  Specifically,  we  focus  on  obstacles  that  are  either  spheres  or  infinite  walls  as  shown  in  Fig.  6.  Our 
approach  to  obstacle  avoidance  can  be  summarized  in  the  following  steps: 

1)  Determine  the  indices  /Vf  (to  be  defined)  of  the  set  of  obstacles  Ok  that  are  neighbors  of  a-agent  i. 
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2)  Create  a  (virtual)  kinematic  /3-agent  at  q,  j;  on  the  boundary  of  a  neighboring  obstacle  Ok  by  projection  where 
qitk  satisfies 

Qi,k  =  argmin^^  \\x  -  qt\\  (54) 

and  Ok  is  either  a  closed  ball  or  a  closed  half  space  on  one  side  of  a  hyperplane. 

3)  Add  a  term  i[)p(\\qitk  ~  Qi IU)  to  the  potential  function  of  a  group  of  a-agents  corresponding  to  each  /3-agent  at 
qi,k  {'f’pi z)  to  be  defined). 


ok 


2ik  :unit  normal 


(a)  (b) 

Figure  6:  Agent-based  representation  of  obstacles:  (a)  a  wall  and  (b)  a  spherical  obstacle. 

This  approach  is  partially  motivated  by  the  work  of  Khatib  [18]  and  Helbing  et  al.  [14].  Fig.  6  schematically 
illustrates  the  position  of  a  /3-agent  induced  by  an  a-agent  in  proximity  of  two  types  of  obstacles.  Later,  we  calculate 
the  velocity  of  a  /3-agent  based  on  the  velocity  of  its  generating  a-agent.  It  is  not  difficult  to  imagine  that  notions 
such  as  nets,  framenets,  and  a-lattices  can  be  generalized  to  (a,  /3)-nets,  (a,  /3)-framenets,  and  constrained  a-lattices. 
We  briefly  present  this  generalization  and  use  it  for  derivation  of  the  flocking  algorithm  with  obstacle-avoidance 
capability. 

7.1  /3-Neighbors  of  a- Agents  and  (a,/3)-Nets 

Let  Va  =  {1,2,  ...,n}  and  Vp  =  {l7, 2 I'}  denote  the  set  of  indices  of  a-agents  and  obstacles  (or  /3-agents), 
respectively.  Notice  that  the  prime  in  elements  of  Vp  is  used  to  guarantee  that  Va  D  Vp  =  0.  An  a-agent  is  called  a 
neighbor  of  an  obstacle  Ok  (k  £  Vp)  if  and  only  if  the  ball  Brfqf)  and  Ok  overlap  (as  shown  in  Fig.  6).  This  form  of 
neighborhood  between  an  a-agent  and  an  obstacle  is  a  mutual  property.  Moreover,  an  a-agent  could  possibly  have 
multiple  neighboring  obstacles.  Particularly,  this  occurs  when  a  group  of  agents  intend  to  pass  through  a  narrow 
pathway  so  that  an  agent  might  come  within  close  proximity  of  multiple  obstacles  (this  will  become  clear  during  the 
squeezing  maneuver) . 

We  define  the  sets  of  a-neighbors  and  /3-neighbors  of  an  a-agent  i  £  VQ  as  follows: 

=  {j  G  Va  :  \\qj  -  ®||  <  r}  (55) 

3Vf  =  {k  G  Vp  :  || qijk  -  qi\\  <  r'}  (56) 

where  r,r'  >  0  are  interaction  ranges  of  an  a-agent  with  neighboring  a-agents  and  /3-agents,  respectively.  Here,  we 
choose  r'  <  r,  but  in  general,  r  and  r'  can  be  chosen  independently. 

Remark  8.  Apparently,  /V“  =  3V).  However,  redefining  the  set  of  neighbors  of  an  a-agent  is  beneficial  for  the  sake  of 
clarity  of  notations  due  to  the  existence  of  multiple  species  of  agents  in  our  upcoming  discussions. 
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The  sets  of  a-  and  /3-neighbors  of  an  a-agent  i  £  Va  naturally  define  an  ( a,0)-net  that  is  a  spatially  induced 
graph  in  the  form 

GaA<l)  =  Ga(q)  +  G0(q)  (57) 

where  Ga(q)  =  (' Va,£a(q ))  is  a  net  induced  by  configuration  of  all  a-agents  and  Gp(q)  =  (Vp, £p{q))  is  a  directed 
bipartite  graph  induced  by  q  and  the  set  of  obstacles  O  =  {Ok  :  k  €  Vp}  where  £p(q)  C  Va  x  Vp.  The  condition 
Va  n  Vp  =  0  guarantees  well-posedness  of  the  definition  of  the  bipartite  graph  Gp(q).  More  explicitly,  we  have 


£a(q)  =  {(m)  :  i  e  Va,  j  £  3V“}, 
£p(q)  =  {(i,k):i£  Va,k£N?}, 


(58) 


and  Ga>p(q )  =  (Va  U  Vp,£a(q)  U  £p(q)).  Similarly,  an  (a,  f3)-framenet  is  a  structure  (Ga,p(q),  g,  g)  where  g  denotes 
the  configuration  of  all  /3-agents.  Keep  in  mind  that  there  are  no  edges  between  two  /3-agents. 

7.2  Constrained  a-Lattices 

The  new  set  of  inter-agent  and  agent-to-obstacle  algebraic  constraints  for  an  a-agent  can  be  specified  as  follows: 

hj-Qi\\  =  d,Vj£N< 


\q%,k  —  <7i||  =  d' ,  \/k  £  iVr 


0 


(59) 


A  constrained  a-lattice  denoted  by  (q,0)  consists  of  an  a-lattice  q  and  a  set  of  obstacles  O  that  satisfy  the  set  of 
constraints  in  (59).  The  relevant  ratios  of  a  constrained  a-lattice  are  n  =  r/d  and  k!  =  d'/d  =  r' /r  (we  assume 
k!  =  k). 


7.3  Multi-Species  Collective  Potentials 

To  achieve  flocking  in  presence  of  obstacles,  we  use  the  following  multi-species  collective  potential  function  for  the 
particle  system: 

V(q)  =  cfV^q)  +  <$Vp(q)  +  c/V^q)  (60) 

where  the  c“,cf,c7  are  positive  constants  and  (a,  a),  (a,/3),  (a,  7)  interaction  potentials  are  defined  as  follows 


Va(q)  = 

^  1  'y  1  t^a(l \qj  ftlioOi 

(61) 

i6Vo  iev„\{i} 

Vp(q)  = 

y  ",  y  ",  'tPp{\\qi,k  ~  Qillcr)) 
i6V0  fegjvf 

(62) 

Vy  (q)  = 

£(>/!  +  lift  -ffrll2-1)- 

(63) 

ieva 


The  function  V1{q)  has  to  do  with  the  navigational  objective  of  a  group  of  a-agents.  The  heterogeneous  adjacency 
between  an  a-agent  at  g^  and  its  neighboring  /3-agent  at  q^f.  is  defined  as 


=  Ph(\\qi,k  -  qiWa/dp), 

where  dp  <  rp  with  dp  =  ||d,||<7,  =  ||r,,||(7.  Define  the  repulsive  action  function 

<t>p{z)  =  Ph{z/dp)(a1(z  -  dp)  -  1) 


(64) 

(65) 


with  <71(2)  =  z/y/ 1  +  z1.  Notice  that  <j>p(z)  vanishes  smoothly  to  zero  at  2  =  dp  and  remains  zero  for  all  2  >  dp. 
This  naturally  defines  a  repulsive  pairwise  potential  ippiz)  in  the  form 


#(z)  =  [  (t>p{s)ds  >  0. 

Jdn 


(66) 


Since  vehicles/robots/animals  in  real-life  cannot  apply  unbounded  forces,  we  avoid  the  use  of  repulsive  potential 
functions  with  unbounded  derivatives  such  as  I/2  or  log(z)  that  are  well-known  examples  of  barrier  functions.  Clearly, 
— 2  <  if'p{z)  <  0  for  all  2  £  R,  and  thereby  the  derivative  of  *l>p{z)  is  uniformly  bounded. 


19 


7.4  Flocking  Algorithm  in  Presence  of  Obstacles 

We  are  ready  to  present  our  main  flocking  algorithm  with  obstacle-avoidance  capability: 

Algorithm  3:  This  algorithm  consists  of  three  terms: 

Ui  =  uf  +  ttf  +  uf  (67) 

where  uf  denotes  the  (cc,  a)  interaction  terms  (i.e.  algorithm  (24)),  uf  denotes  the  {a,  (3)  interaction  terms,  and  uf 
is  a  distributed  navigational  feedback.  We  explicitly  specify  each  term  in  equation  (67)  as  follows: 

<  =  (68) 
je  Nf  j&N? 

Ui  =  <1  E  ~  9i||<r)hj,fe  +  Cf2  ^2  bi,k{q)(Pi,k  -  Pi)  (69) 

keN f  jeN? 

u f  =  —cjai(qi  -  qr)  -  cf(pi  -  pr)  (70) 

where  o\ (z)  =  zf sjl  +  |h||2  and  df  are  positive  constants  for  all  77  =  1,2  and  v  =  a,  (3, The  pair  (■ qr,pr )  is  the 
state  of  a  static/dynamic  7-agent.  The  vectors  n,;j  and  are  given  by 

_  q-j  ~  qi  ,  _  gi.fc  ~  qi 

lJ  \/1  +  eW<lj  -  Pill2’  V1  +  ell 9i,k  ~  QiW2 

The  only  missing  piece  of  the  puzzle  is  the  method  of  calculation  of  position  and  velocity  of  /3-agents  that  is  discussed 
in  details  in  the  next  section. 

In  terms  of  sensing  requirements,  we  assume  that  every  a-agent  is  equipped  with  range  sensors  that  allows  the 
agent  to  measure  the  relative  position  between  the  closest  point  on  an  obstacle  and  itself.  Both  radars  and  laser 
radars  (or  ladars)  can  be  used  as  range  sensors,  therefore  this  assumption  is  feasible  in  practice.  For  the  purpose  of 
simulation  of  flocking  behavior,  we  use  the  projection  of  the  position  of  an  a-agent  on  the  boundary  of  an  obstacle. 

7.5  Calculation  of  Position  and  Velocity  of  /3-Agents 

Given  an  obstacle  Ok  and  its  neighboring  a-agent  with  state  ( qi,Pi ),  the  position  and  velocity  of  a  /3-agent  on  a  wall 
or  a  sphere  is  given  by  the  following  lemma: 

Lemma  3.  Let  qi,k,Pi,k  with  ( i,k )  £  Va  x  Vp  denote  the  position  and  velocity  of  a  (3-agent  generated  by  an  a-agent 
with  state  ( qi,Pi )  on  an  obstacle  Ok-  Then 

i)  For  an  obstacle  with  a  hyperplane  boundary  that  has  a  unit  normal  &k  and  passes  through  the  point  yk,  the 
position  and  velocity  of  the  (3-agent  are  determined  by 

Qi,k  =  PQi  +  (7  -  P)Vk,  Pi,k  =  PPi 
where  P  =  I  —  is  a  projection  matrix. 

ii)  For  a  spherical  obstacle  with  radius  Rk  centered  at  yk,  the  position  and  velocity  of  the  (3-agent-  are  given  by 

qi,k  =  Mi +  ( 1  -  A i)yk,  Pi,k  =  pPpi 
where  p  =  Rk/\\qi  -  yk\\,  =  {qt  -  yk)/\\q-i  ~  Vk ||,  and  P  =  I  -  afca 

Proof.  We  provide  the  proof  for  two  cases:  a  wall  and  a  sphere. 

i)  Wall:  In  this  case,  the  boundary  of  the  obstacle  is  a  hyperplane  that  can  be  specified  by  a  point  yk  and  unit 
normal  vector  a/c  as  h-k  :  a k(y  —  yk)  =  0. 

The  position  of  a  /3-agent  on  a  hyperplane  a^(y  —  yk)  =  0  is  a  point  q-i,k  given  by 

Qi,k  =  PQi  +  (7  -  P)yk  (71) 
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One  can  readily  verify  that  this  point  is  on  the  hyperplane  hk  and  qi  —  qi tk  is  orthogonal  to  the  surface  of  the 
hyperplane.  Since  a k,yk  are  fixed,  the  velocity  Pig-  :=  q^^  of  a  /3-agent  on  hk  is  given  by 

Pi,k  =  Ppi  =  Pi^  (&kPi)ak  (72) 


Clearly,  the  velocity  of  a  /3-agent  is  parallel  to  the  wall,  or  a kPi,k 


0.  This  finishes  the  proof  of  part  i). 


ii) 


Spherical  Obstacle:  In  this  case,  the  boundary  of  the  obstacle  is  a  sphere  of  radius  Rk  centered  at  yk ■  Define 
p  as 


—  ^ k 

hi-yk\\ 


_ Rk _ 

Rk  T  || qi  ft, fell 


(73) 


and  notice  that  the  projection  of  qi  on  the  boundary  of  the  obstacle  Ok  can  be  obtained  by  a  convex  combination 
of  qi  and  ijk  as 

®,fc  =  pqi  +  (1  -  p)yk  (74) 

with  p  £  (0, 1]  (simply  because  these  three  points  are  collinear).  The  value  p  =  1  corresponds  to  two  cases:  1) 
as  Rk  — »  oo,  a  sphere  asymptotically  approaches  a  flat  surface  (or  hyperplane)  and  2)  when  an  a-agent  and  its 
corresponding  /3-agent  coincide.  By  differentiating  qhk  in  time,  we  get 


Pi,k  =  qi,k  =  ppi  +  Ate  -  yk)  =  ypi  +  All  ®  -  yk\\ak 

where  &k  =  {qt  —  J/fc )  / 1 1  —  2/fell  is  the  unit  normal  to  the  sphere  at  Ai,fc-  Due  to  the  fact  that  yk,Rk  are  fixed, 

according  to  equation  (73),  we  have 

All®  -  Vk\\  +  pa  I  Pi  =  o. 

Hence 

Pi,k  =  PPi  -  A <(afcPi)afc  =  p(I  -  akal)pi  =  (pP)pi 

and  this  finishes  the  proof  of  part  ii).  □ 

The  following  lemma  demonstrates  that  the  second  term  in  uf  is  in  fact  a  valid  damping  force.  This  fact  is  used 
later  to  establish  that  the  overall  particle  system  is  dissipative. 

Lemma  4.  The  force  fd  between  a-agents  and  /3-agents  with  elements  ff  =  XDfceJV3  bi,k(Pi  —  Pi,k)  is  a  valid  damping 
force,  i.e.  let  I\r  =  \  JT  ||p2;||2  and  suppose  pi  =  ff,  then  Kr  <  0. 

Proof.  By  differentiating  Kr  in  time,  we  get 

Kr=  ^2  ^  bi,k{Pi,Pi,k  -  Pi)-  (75) 

ieva  fegjvf 

The  velocity  of  a  /3-agent  is  related  to  p,  via  the  following  equation 

Pi,k  =  pPPi 

where  P  =  I  —  a^a^  and  afe  is  the  unit  normal  to  the  surface  of  the  obstacle.  Moreover,  for  a  wall  p  =  1  and  for  a 
sphere  p  £  (0,1].  In  both  cases,  the  following  inner  product  is  always  non-positive 

{PhPi,k-Pi)  =  p{pJPPi)  -pjpi  =  -  {Ma lPi)2  +  (1  -  M)lbiH2}  <  o. 

Due  to  non-negativity  of  the  heterogeneous  adjacency  elements  bl  k,  we  get  I\r  <  0.  □ 
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7.6  Analysis  of  Flocking  with  Obstacle  Avoidance 

A  natural  question  is  whether  the  particle  system  obtained  by  applying  Algorithm  3  is  dissipative.  The  answer  in 
this  case  is  not  as  predictable  as  the  case  of  interactions  among  a-agents.  The  reason  is  that  in  free-flocking,  every  a- 
agent  reciprocates  the  action  of  its  neighboring  a-agents,  but  in  constrained  flocking  the  (a,  /3)-net  is  a  unidirectional 
graph  (or  digraph). 

Theorem  6.  Consider  a  particle  system  applying  Algorithm  3  (or  protocol  (67) ).  Assume  that  the  7- agent  is  a  static 
agent  with  a  fixed  state  (qr,pr)  =  (qd,Pd)-  Define  the  energy  function  H(q,p)  =  V(q)  +  T(q,p)  with  kinetic  energy 
T(q,p)  =  |  1  ||pi||2.  Suppose  there  exists  a  finite  time  to  >  0  such  that  the  average  velocity  of  all  agents  satisfies 

the  condition 

Tl 

^{Pc(t),pd)  <T(q(t),p(t)),  Vt  >  to-  (76) 

Then,  the  energy  of  the  system  is  monotonically  decreasing  (i.e.  H (q(t) ,  p(t))  <  0,)  along  the  trajectory  of  the  collective 
dynamics  of  the  multi-species  system  for  all  t  >  to- 

Proof.  By  direct  differentiation,  we  have 

H(q,p)  =  (VVa(q),p)  +  {\7qVp{q),p)  +  (VVy(q),p)  +  {\7gVp{q),p)  +  ^  (p»,  uf  +  uf  +  u?) 

ieva 

=  Ci(\7qVf3(q),p)  +  c 2  ^2  aij{q)(pi,pj  -  pi) 

(i,j)€£a(g) 

+  C2  bih(Pi,Pi,k  -  Pi)  -  cl  ^2  (Pi’Pi  Pd)  • 

*evQ  keNf  *evQ 

But  _  _ 

(^qVp(q)iP) =  'y  ]  y '  iPi,k)  =  y  ]  y  ^  \qj  —  t?* 1 1 o- ) ( , t?* , ^ )  =  o,  (77) 

ieva  kEN f  fceivf 

because  pi ^  is  tangent  to  the  surface  of  the  obstacle,  whereas  is  orthogonal  to  the  surface  of  the  obstacle.  Thus, 
H(q,p)  satisfies 

H{q1p)  =  -cf{pTL{q)p)+c02^2  ^2  Kk<<Pi> Pi*  ~  Pi)  ~  2c^(T(g,p)  -  •  pc))  <  0,  Vt  >  t0  (78) 

»evQ  keNf 


where  the  second  term  in  the  last  inequality  is  negative  semidefinite  based  on  Lemma  4  and  the  term  T{q,p)  — 
(n/2)(pj  ■  pc)  is  by  assumption  non-negative  for  all  t  >  to-  □ 

The  interpretation  of  condition  (76)  for  a  group  of  particles  with  equal  velocities  is  interesting.  In  this  case, 
Pc  =  Pi  for  all  i,  and  therefore  (76)  reduces  to  the  inequality  pjpu  <  l|Pc||2-  Let  0c,d  denote  the  misalignment  angle 
between  vectors  pc  and  pd  in  IRm,  i.e.  cos (6b, d)  =  (pc  •  Pd)/(||Pc||  •  ||pd||)-  Suppose  pc,Pd  ^  0,  then  the  group  has  to 
be  sufficiently  agile,  or  ||pc||  >  vo  :=  \\pd\\  cos(0Ctd)-  Intuitively,  this  can  be  interpreted  as  a  collective  effort  by  the 
group  to  keep  up  with  the  desired  velocity  pd ■  For  a  ^y-agent  with  Pd  =  0,  condition  (76)  trivially  holds. 

Analysis  of  an  equilibrium  state  of  a  group  of  dynamic  agents  that  perform  flocking  in  presence  of  obstacles  makes 
less  sense  when  the  flock  does  not  pass  around  all  the  obstacles.  To  be  more  precise,  it  is  less  interesting  to  analyze 
the  stability  of  the  equilibrium  of  collective  dynamics  of  a  flock  while  some  /3-agents  are  permanently  present.  This 
is  certainly  not  the  case  for  problems  such  as  sensor  placement  and  distributed  sensing  [5] .  On  the  other  hand,  if  one 
assumes  that  after  some  finite  time  t\  >  0,  no  a-agent  ever  comes  near  an  obstacle,  the  case  reduces  to  analysis  of 
free-flocking  that  has  already  been  presented.  Hence,  we  postpone  a  comprehensive  analysis  of  the  behavior  of  flocks 
in  permanent  presence  of  obstacles  for  mobile  sensor  networks  to  a  future  occasion. 

7.7  Information  Flow  in  Constrained  Flocking:  A  Peer-to-Peer  Network 

The  information  flow  in  flocking  with  obstacle  avoidance  has  a  natural  hierarchical  architecture  as  shown  in  Fig.  7  (a). 
A  7-agent  has  the  role  of  a  virt.ual-leader  (or  commander)  in  charge  of  navigation  and  control  of  the  behavior  of  a 
flock  as  a  whole.  As  a  result,  the  hierarchy  in  Fig.  7  (a)  can  be  referred  to  as  a  virtual-leader /follower  architecture. 
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The  dashed  line  between  the  7-agent  and  all  a-agents  indicates  a  single  information  exchange  at  t  =  0  (otherwise, 
the  algorithm  becomes  centralized).  Note  that  a  virtual-leader/follower  architecture  should  not  be  confused  with  a 
leader/follower  architecture  in  which  the  leader  is  one  of  the  physical  agents  (e.g.  a  vehicle  in  a  multi-vehicle  system 
or  a  fish  in  a  school). 


Figure  7:  The  in-agent  and  intra-agent  information  flow  in  constrained  flocking:  (a)  a  virtual-leader/follower  hierar¬ 
chical  architecture  and  (b)  a  peer-to-peer  architecture. 


Since  the  computation  required  for  implementation  of  virtual  agents  has  to  be  carried  out  by  embedded  computers 
of  a  physical  agent,  Fig.  7  (a)  does  not  provide  a  realistic  picture  of  the  computational  architecture  necessary  for 
implementation  of  Algorithm  3.  Though,  the  hierarchical  architecture  is  useful  in  understanding  why  a  7-agent  plays 
the  role  of  a  unifying  objective  that  brings  all  the  a-agents  together  and  assembles  a  connected  network  of  mobile 
agents. 

To  model  the  information  flow  of  Algorithm  3,  we  create  one  7-agent  corresponding  to  each  a-agent  as  shown  in 
Fig.  7  (b).  The  new  architecture  is  a  peer-to-peer  network  that  represents  the  interactions  of  a  group  of  macro-agents 
(see  Fig.  8).  Each  macro-agent  consists  of  an  a-agent  and  its  corresponding  7-  and  /3-agents  as  illustrated  in  Fig.  8. 
The  dynamics  of  the  macro-agent  of  Algorithm  3  is  highly  structured  (Fig.  8  (a)).  Fig.  8  (c)  demonstrates  that 
Algorithms  1  &  2  are  special  cases  of  Algorithm  3  and  can  be  implemented  using  a  peer-to-peer  network. 

In  this  network  of  macro-agents,  two  macro-agents  only  communicate  the  state  of  their  public  components  (i.e.  ex- 
agents).  Under  the  assumption  that  the  initial  state  and  dynamics  of  all  7-agents  are  equal,  the  virtual- leader/follower 
and  peer-to-peer  architectures  become  equivalent  representations  of  a  multi-species  particle  system. 

The  biological  implication  of  feasibility  of  performing  tracking/migration  for  groups  of  dynamic  agents  using  a 
peer-to-peer  network  is  that  ‘‘flocks  need  no  leaders'’.  This  mathematically  confirms  a  fact  that  has  been  known  to 
animal  behavior  scientists  for  years  [47]. 


< 


a-agent  (public):  | 

7-agent  (private):  | 

/3-agents  (private):  { 

(a) 


cti  =  Pi 
Pi  =  Ui 

qr  =  pr 
Pr  =  fr(qr,Pr) 

Qi,k  =  Pi,k 


Macro-Agent 


Figure  8:  Macro-agent:  (a)  dynamics,  (b)  information  flow  among  species  for  Algorithm  3,  and  (c)  nested  diagrams 
of  macro-agents  for  Algorithms  1,  2,  3. 


7.8  Conflict  of  Tasks  in  Constrained  Flocking 

It  is  not  difficult  to  imagine  that  given  a  non-convex  obstacle  Ok,  there  might  be  multiple  /3-agents  on  Ok  that  are 
equally  close  to  a  generating  a-agent.  Assuming  that  all  of  these  /3-agents  repel  this  a-agent,  one  might  expect 
that  in  certain  situations  there  would  be  a  conflict  of  tasks  between  obstacle  avoidance  by  a  group  of  a-agents  and 
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achieving  a  group  objective  specified  by  a  7-agent.  An  example  of  this  scenario  is  shown  in  Fig.  9  (a).  In  this  case, 
a  group  of  a-agents  get  trapped  and  achieve  only  one  of  their  two  conflicting  objectives. 

The  same  scenario  can  occur  in  presence  of  a  convex  obstacle  as  well.  This  is  illustrated  in  Fig.  9  (b).  In  this  case, 
if  the  agents  pass  through  the  wall  and  reach  their  destination,  they  have  clearly  violated  their  obstacle  avoidance 
objective.  If  they  stay  behind  the  wall  and  avoid  collision  to  the  wall,  they  can  no  longer  reach  their  destination  as 
specified  by  the  7-agent.  This  raises  a  feasibility  question  to  make  sure  that  no  conflict  of  tasks  exist  for  some  agents 
during  constrained  flocking. 


Obstacle 


Y-Agent 

(Destination) 


(a) 


Y  -Agent 
(Destination) 


Figure  9:  Trapped  a-agents  due  to  conflicting  objectives:  (a)  a  non-convex  obstacle  and  (b)  a  convex  obstacle. 


The  use  of  a  more  sophisticated  obstacle  avoidance  approach  eliminates  getting  trapped  behind  an  obstacle. 
A  successful  example  of  such  an  approach  is  the  use  of  gyroscopic  forces  for  obstacle  avoidance  in  [3,  4],  For  a 
comprehensive  treatment  of  obstacle  avoidance  in  robotics,  please  refer  to  Latombe  [20] . 


8  Simulation  Results 

In  this  section,  we  present  several  simulation  results  of  2-D  and  3-D  flocking.  For  every  case,  a  computer  animation 
is  available  upon  request.  The  following  parameters  remain  fixed  throughout  all  simulations:  d  =  7,  r  =  1.2 d  (or 
k  =  1.2),  d'  =  0.6 d,  r'  =  1.2 d' ,  e  =  0.1  (for  er-norm),  a  =  b  =  5  for  h  =  0.2  for  the  bump  function  of  <t>a{z), 
h  =  0.9  for  the  bump  function  of  4>p{z ),  and  the  step-size  in  all  simulations  ranges  between  0.01  to  0.03  seconds 
(equivalent  to  an  update  frequency  of  33  Hz  to  100  Hz).  The  parameters  of  the  flocking  algorithms  and  the  types  of 
the  initial  states  are  specified  separately  for  each  experiment.  The  set  of  l  spherical  obstacles  are  specified  with  an 
(to  +  1)  x  l  matrix  Ms  where  each  column  of  Ms  is  the  vector  col (yk,Rk)  G  Rm+1. 

In  all  simulation  results,  the  heading  angle  (or  attitude)  of  each  a-agent  specifies  the  direction  of  the  velocity  of 
that  agent.  In  addition,  the  position  of  a  dynamic  7-agent  is  marked  with  a  x  sign. 

8.1  2-D  Flocking  in  Free-Space  (n  =  150) 

Fig.  10  shows  consecutive  snapshots  of  2-D  flocking  for  150  agents  in  free-space  using  Algorithm  2.  The  initial 
positions  are  chosen  randomly  from  a  Gaussian  distribution  with  variance  of  2500.  The  initial  velocity  coordinates 
are  uniformly  chosen  at  random  from  the  box  [—2,  —  l]2.  A  flock  is  formed  in  Fig.  10  (d)  and  maintained  thereafter. 
A  dynamic  7-agent  is  used  for  this  example.  Fig.  11  demonstrates  the  framenets  corresponding  to  the  conformations 
of  the  agents  given  in  Fig.  10.  The  number  of  edges  of  the  dynamic  graph  G(q(t))  increases  by  time  and  has  a 
tendency  to  render  the  net  connected.  The  set  of  initial  positions  are  chosen  uniformly  at  random  so  that  the  net 
G(g(0))  is  highly  disconnected  (i.e.  has  too  many  components).  This  makes  the  task  of  flocking  more  challenging. 
The  planarity  of  the  framenets  in  Figs.  10  (c)  through  (f)  is  very  clear.  Numerical  measurements  indicate  that  the 
final  conformation  is  a  low-energy  quasi  a-lattice  that  induces  a  flock  (see  Fig.  18  (a)).  These  observations  are  in 
close  agreement  with  our  theoretical  predictions  in  Section  5. 
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Figure  10:  2-D  flocking  for  n  =  150  agents. 


8.2  2-D  Fragmentation  in  Free-Space  (n  =  40) 

Fig.  12  demonstrates  the  fragmentation  phenomenon  for  n  =  40  agents  applying  Algorithm  1.  It  is  not  surprising 
that  with  a  random  set  of  initial  states,  flocking  behavior  is  not  created.  In  Fig.  12  (f),  one  can  identify  9  distinct 
small  flocks  (each  contains  at  list  two  agents)  and  three  individual  agents. 

In  Algorithm  1  (or  the  (a,  a)  protocol),  no  y-agent  exists  due  to  lack  of  existence  of  a  group  objective.  This 
simulation  result  is  another  evidence  that  demonstrates  creation  of  flocking  motion  is  rather  nontrivial  because  the 
idea  of  using  a  gradient-based  control  law  plus  a  velocity  matching  term  does  not  necessarily  work! 

Fragmentation  is  a  generic  form  of  collective  behavior  of  agents  applying  Algorithm  1.  This  behavior  is  insensitive 
to  the  type  of  probability  distribution  of  the  initial  position  of  the  agents.  Apparently,  for  the  case  of  a  highly  dense 
initial  net  with  small  initial  velocity  mismatch,  one  might  expect  that  the  group  of  agents  form  a  giant  component 
(i.e.  a  connected  subgraph  with  a  large  order). 

In  Figs.  12  (d)  through  (f),  it  can  be  observed  that  two  agents  which  belong  to  two  different  flocks,  move  further 
apart  from  each  other  as  time  goes  by.  Again,  this  is  a  generic  property  of  fragmentation.  Fragmentation  phenomenon 
can  be  viewed  as  lack  of  cohesion  in  a  group  of  particles  (see  Fig.  18  (b)). 

8.3  3-D  Flocking  in  Free-Space:  Automated  Rendezvous 

Fig.  13  shows  the  consecutive  snapshots  of  3-D  flocking  for  a  group  of  n  =  50  agents  using  Algorithm  2.  Each  agent 
represents  a  UAV  moving  in  R3.  The  initial  state  of  the  agents  is  chosen  at  random  with  a  Gaussian  distributed. 
The  attitude  of  each  UAV  is  a  rotation  matrix  Ri  £  50(3)  with  columns  ri,r2,r3.  We  use  the  following  steps  to 
determine  Ri  from  velocity  pi  /  0:  i)  set  r\  =  Pi/||pi||  and  let  e3  =  (0,  0, 1)T,  ii)  set  r2  =  e3  x  n,  and  iii)  set 
^3  =  ri  x  T2  (x  denotes  the  cross-product  in  R3).  For  pi  =  0,  define  Ri  =  I3.  Based  on  this  experiment,  flocking  can 
be  used  as  a  means  of  automated  rendezvous  (or  gathering)  for  a  medium  to  large  number  of  autonomous  agents.  It 
is  apparent  that  after  some  finite  time,  the  agents  self-assemble  a  connected  network  and  maintain  its  connectivity 
thereafter.  The  formal  proof  of  this  statement  requires  the  proof  of  Conjecture  1  in  Section  5. 
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Figure  11:  2-D  flocking  for  n  =  100  with  a  dynamic  topology. 


8.4  Split/Rejoin  Maneuver:  Low- Altitude  Flight  of  UAVs  and  Predator  Evasion 

Consider  a  group  of  agents  that  intend  to  move/migrate  from  point  A  to  B.  Here,  A  and  B  are  the  positions  of 
the  center  of  mass  (CM)  of  the  group  at  the  group’s  source  and  destination.  Whenever  there  are  multiple  obstacles 
along  the  straight  line  connecting  A  to  B ,  the  agents  cannot  pass  through  the  obstacles.  As  a  result,  they  might  split 
in  two  or  multiple  smaller  groups.  This  maneuver  is  useful  for  missions  that  require  low-altitude  flight  of  UAVs  or 
moving  in  urban  environments.  In  schools  of  fish,  the  split/rejoin  maneuver  is  used  as  a  predator  evasion  tactic  [36]. 

The  objective  in  performing  a  split/rejoin  maneuver  is  to  gather  various  groups  that  have  initially  split  due  to 
the  presence  of  obstacles  or  adversarial  agents.  The  split/rejoin  maneuver  is  demonstrated  in  Figs.  14  and  15  for 
a  group  of  n  =  150  agents  in  presence  of  l  =  6  obstacles.  Fig.  15  demonstrates  the  evolution  of  the  topology  of 
inter-agent  interactions.  Based  on  this  figure,  it  is  clear  that  the  topology  of  a  network  of  dynamic  agents  during 
flocking  undergoes  frequent  changes.  In  other  words,  flocking  involves  stability  analysis  for  a  network  of  dynamic 
agents  with  switching  topology  (as  in  [33]). 

The  initial  position  of  the  agents  are  chosen  uniformly  at  random  from  the  box  [ — 40,  80] 2 .  The  initial  velocities 
are  set  to  zero.  The  group  objective  is  specified  by  a  static  y-agent  with  qd  =  (200, 30)T  and  pd  =  (5,  0)T.  Moreover, 
c“  <  cl  <  Ci  and  c £  =  2^/cf  for  all  species.  The  matrix  of  obstacles  is 
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Based  on  Fig.  15,  after  all  agents  pass  the  obstacles  on  their  way,  the  group  forms  a  giant  flock.  It  was  numerically 
verified  that  no  agent  ever  entered  any  of  the  six  obstacles  for  the  complete  trajectory  of  the  particles.  Fig.  14 
illustrates  the  split /rejoin  maneuver  without  drawing  the  edges  of  the  (a,/?)-net  at  each  moment. 


26 


t=0  (sec) 


t=0.57  (sec) 


t=1 .77  (sec) 


0  20  40  60  80" 


x  (pos) 

(c) 

t=17.97  (sec) 
140 
120 
100 


80 


-20  _ i _ i _ i _ 

-50  0  50  100  150 

x  (pos) 

(f) 


Figure  12:  The  fragmentation  phenomenon  for  40  agents  applying  Algorithm  1. 


8.5  Squeezing  Maneuver:  Moving  through  Narrow  Spaces 


The  squeezing  maneuver  is  the  result  of  flocking  in  presence  of  obstacles  that  are  relatively  close  to  each  other.  This 
a  special  case  of  escape  panic  phenomenon.  By  “relatively  close”,  we  mean  that  the  narrow  pathway  between  the 
obstacles  is  about  2 r  to  3 r  wide.  Figs.  16  and  17  illustrate  the  task  of  squeezing  maneuver  for  n  =  150  agents.  The 
initial  positions  of  the  agents  are  n  =  150  random  points  that  are  uniformly  distributed  in  the  box  [0, 120] 2 .  The 
initial  velocity  of  all  agents  is  set  to  zero.  For  this  case,  the  group  objective  is  specified  by  a  static  7-agent  with 
qd  =  (230,60)t  and  pd  =  (6,0)T.  In  addition,  c“  <  cj  <  cf  and  =  2 yjd(  for  v  =  a,  (3, 7.  The  matrix  of  obstacles 
is  given  by 


Ms 


150  150 
30  100 

25  25 


According  to  Fig.  17,  one  can  observe  that  the  agents  avoid  collision  with  both  obstacles  as  moving  forward.  This  has 
been  numerically  verified  for  the  entire  trajectory  of  the  particles.  Since  the  desired  group  velocity  is  non-zero,  the 
group  does  not  stop  near  qd  and  moves  along  the  specified  desired  group  velocity  pd ■  After  passing  both  obstacles, 
the  agents  form  a  giant  flock  as  shown  in  Fig.  17  (f). 


9  What  Constitutes  Flocking? 

In  [35],  Partridge  provides  a  brief  survey  of  various  definitions  of  “schooling  in  fish”  by  animal  behavior  scientists 
that  spans  half  a  century  from  1927  to  1981.  The  length  of  this  period  is  a  clear  indication  of  the  difficulty  of  the 
task  in  hand.  To  give  an  objective  definition  of  flocking,  we  determine  a  quantitative  measure  of  flocking  that  is 
independent  of  collective  dynamics  of  the  agents.  In  the  sense  that  it  does  not  depend  on  a  specific  method  used 
for  generation  of  trajectories  of  particles,  i.e.  the  measure  is  universal.  In  the  following,  we  define  a  special  form  of 
flocking  called  a- flocking: 
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Figure  13:  Snapshots  of  3-D  flocking/automated  rendezvous  using  Algorithm  2  for  n  =  50  UAVs. 


Definition  5.  (a-flocking)  Let  z  :  t  i— >  col (q(t),p(t))  be  the  state  trajectory  of  a  system  of  n  dynamic  agents  (or 
particles).  We  say  a  group  of  agents  perform  a- flocking  over  the  time  interval  [to,t/]  if  there  exists  relatively  small 
numbers  eo,  £i,  £2  >  0  and  a  distance  d  >  0  such  that  the  trajectory  z(t)  satisfies  all  the  following  conditions  for  all 
t  G  [to,  tf]  with  an  interaction  range  r  =  (1  +  £o)ci: 

i)  The  group  remains  a  quasi-flock  (i.e.  G(q(t))  has  a  giant  component). 

ii)  The  group  remains  cohesive. 

iii)  The  deviation  energy  remains  small  (or  E(q(t))  <  e\d2). 

iv)  The  velocity  mismatch  remains  small  (or  K{y(t))  <  £2n). 

A  more  strict  form  of  flocking,  or  strict  a-flocking,  can  be  defined  by  replacing  the  above  four  conditions  with  the 
following  three  properties: 

a)  The  group  remains  a  flock  (i.e.  net  G(q(t))  is  connected). 

b)  The  deviation  energy  remains  small  (i.e.  E(q(t))  <  d2). 

c)  The  velocity  mismatch  remains  small  (i.e.  K(v(t))  <  £2 n). 

One  can  use  conditions  a)  and  b)  to  establish  that  the  group  remains  cohesive  over  the  interval  [to,  tf].  Definition  5 
has  the  same  role  for  flocking  in  particle  systems  that  Lyapunov  stability  has  for  nonlinear  dynamical  systems.  It 
is  worthwhile  mentioning  that  “regular  fragmentation”  violates  conditions  i),  ii),  and  iv)  of  Definition  5,  “irregular 
fragmentation”  violates  all  four  conditions  of  a-flocking,  and  “irregular  collapse”  severely  violates  condition  iii). 
Therefore,  irregular/regular  fragmentation  and  irregular  collapse  do  not  constitute  a-flocking  as  mentioned  in  Sec¬ 
tion  1.  Furthermore,  “regular  collapse”  is  an  acceptable  form  of  a-flocking  for  when  a  comfortable/safe  inter-agent 
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Figure  14:  The  split  /rejoin  maneuver  for  n  =  150  agents. 


distance  d  is  replaced  by  an  uncomfortable  distance  d'  <C  d.  Surprisingly,  regular  collapse  phenomenon  can  be  found 
in  nature  as  a  defense  mechanism  used  by  schools  of  fish. 

Formation  flight  (e.g.  for  birds)  can  be  viewed  as  the  most  strict  form  of  a-flocking  with  ei  =  £2  =  0  and  a 
fixed  topology  G(q(t))  =  G(t0),V t  £  [to,tf]-  This  is  consistent  with  the  prediction  of  Theorem  3  (part  ii))  that 
asymptotically  the  topology  of  the  network  of  agents  evolves  to  a  fixed  graph  G*  =  G(x^). 

The  main  feature  of  Definition  5  is  that  a-flocking  can  be  numerically  verified  for  the  trajectories  of  a  system 
of  particles  regardless  of  the  method  of  trajectory  generation.  Meaning  that  the  definition  of  a-flocking  is  universal 
(or  algorithm-independent) .  This  is  analogous  to  universality  of  the  definition  of  “Lyapunov  stability”  for  nonlinear 
systems  (Lyapunov  stability  is  a  property  of  the  solutions  of  a  nonlinear  system  and  not  its  vector  field).  The 
challenge  is  to  search  for  parameters  eo,  ei,  £2,  d.  This  verification  process  is  discussed  in  Section  9.1. 

9.1  Verification  of  a-Flocking 

To  verify  whether  a  group  of  particles  perform  a-flocking,  we  need  to  calculate  four  quantities  along  the  trajectory 
of  the  particles.  These  quantities  are  defined  in  the  following: 

i)  Relative  Connectivity:  Since  the  rank  of  Laplacian  of  a  connected  graph  of  order  n  is  at  most  (n—  1),  we  define 
the  relative  connectivity  of  the  group  at  time  t  as  C(t)  =  -Vj-rank(L(g(t)))  £  [0, 1],  where  L(q)  is  the  adjacency 
matrix  of  a  graph  with  0-1  adjacency  elements  corresponding  to  the  set  of  edges  of  the  net  G(q). 

ii)  Cohesion  Radius:  We  define  the  cohesion  radius  of  a  group  of  agents  at  time  t  as  R(t)  =  max,ev  \\Qi(t)  ~  <Zc(t)||- 
A  cohesive  group  has  a  finite  cohesion  radius. 

iii)  Normalized  Deviation  Energy:  E(q)  =  E(q)/d2. 

iv)  Normalized  Velocity  Mismatch:  K(v)  =  K(v)/n. 
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Figure  15:  The  split /rejoin  maneuver  for  n  =  150  agents. 
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To  clarify  the  use  of  these  quantities,  consider  the  trajectory  of  n  =  150  particles  in  simulation  of  2-D  flocking 
in  Section  8.1  (Figs.  10,  11).  The  curves  C,R,E,K  for  this  trajectory  are  plotted  in  Fig.  18  (a)  over  the  first  300 
iterations.  (The  step-size  is  T  =  0.03  (sec)  and  t  =  kT  where  k  is  the  iteration  number.)  At  iteration  kc  =  134,  a 
phase  transition  occurs  and  the  net  G(q(t ))  becomes  connected.  Clearly,  the  network  topology  remains  connected 
for  all  future  iterations  k  >  kc.  The  point  k  =  kc  is  shown  by  a  dished  line.  The  effect  of  this  phase  transition  is 
clear  in  the  (normalized)  velocity  mismatch  curve  after  k  =  170.  In  this  case,  the  cohesion  radius  is  monotonically 
decreasing.  It  is  also  clear  that  the  (normalized)  energy  deviation  remains  relatively  small  after  k  =  170  iterations. 
Based  on  the  simulation  data,  we  conclude  that  a-flocking  is  achieved  after  the  170th  iteration  with  parameters 
e0  =  0.2,  ei  =  0.005,  e2  =  0.3. 

In  contrast,  Fig.  18  (b)  shows  the  four  curves  obtained  from  the  trajectory  of  particles  in  Fig.  12.  Here  are 
some  observations:  1)  the  cohesion  radius  is  monotonically  increasing,  2)  the  net  never  becomes  connected  and  has 
too  many  components,  3)  the  velocity  mismatch  never  reduces  below  a  large  constant,  and  4)  the  deviation  energy 
asymptotically  vanishes  implying  conformation  of  a-lattices.  All  these  facts  are  consistent  with  the  occurrence  of  the 
regular  fragmentation  phenomenon  because  only  condition  iii)  of  a-flocking  is  satisfied. 

A  better  measure  of  relative  connectivity  is 


ig(m 

'  \£(G)\ 


(79) 


where  T*  is  the  connected  subgraph  of  G  with  the  highest  number  of  nodes.  We  refer  to  C*  as  the  semi- connectivity 
factor  of  a  graph.  The  advantage  of  C*  over  C  is  the  ability  to  distinguish  fragmentation  phenomenon  from  flocking 
with  high  confidence.  For  example,  in  a  quasi-flock  of  n  =  100  agents  that  consists  of  5  components  with  population 
of  1, 1, 1, 1, 96,  we  have  Cl  =  0.96  and  C\  =  95/99,  whereas  in  a  group  of  5  flocks  each  with  20  agents  C%  =  0.2  and 
C2  =  95/99.  The  separation  gap  of  the  semi-connectivity  factor  is  AC*  =  | C/  —  C||  =  0.76.  This  is  a  very  large  gap 
compared  to  the  zero  gap  obtained  from  the  ranked-based  factor  C. 
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Figure  16:  The  squeezing  maneuver  for  n  =  150  agents. 


A  second  example  is  the  fragmentation  phenomenon  shown  in  Fig.  12  where  the  final  conformation  has  a  semi¬ 
connectivity  factor  of  C*  =  7/40  =  0.175  <C  1  and  a  ranked-base  factor  of  C  =  28/40  =  0.7.  Clearly,  C  is  deceptively 
high. 

Remark  9.  An  algorithm  is  given  in  [4]  that  leads  to  creation  of  flocking  behavior  in  simulations  (no  analysis  of 
flocking  is  available  for  this  algorithm) .  The  foundation  of  this  algorithm  has  to  do  nothing  with  all  three  algorithms 
presented  in  this  paper.  I  would  like  to  conjecture  that  the  agents  applying  the  flocking  algorithm  in  [4]  are  capable  of 
asymptotically  performing  a-flocking  (i.e.  3 T  >  0  :  a-flocking  holds  for  the  trajectory  of  the  particles  for  all  t  >  T). 

10  Conclusions 

This  paper  provides  a  theoretical  framework  for  design  and  analysis  of  distributed  flocking  algorithms  for  multi-agent 
dynamic  systems.  The  cases  of  flocking  in  free-space  and  presence  of  obstacles  were  both  considered.  It  turns  out 
that  a-lattices  and  quasi  a-lattices  are  point  sets  with  important  geometric  and  graph  theoretic  properties  that  have 
a  crucial  role  in  construction  of  collective  potential  functions  for  flocking.  These  collective  potentials  were  used  for 
both  derivation  and  analysis  of  all  three  flocking  algorithms. 

First,  we  discussed  that  the  use  of  the  (a,  a)  protocol  alone  generically  leads  to  regular  fragmentation.  Then, 
Algorithm  2  was  constructed  from  the  (a,  a)  flocking  protocol  by  adding  a  navigational  feedback.  This  navigational 
feedback  takes  the  group  objective  into  account  using  a  static/dynamic  7-agent.  It  was  demonstrated  that  Algo¬ 
rithm  2  generically  leads  to  flocking.  Two  conjectures  were  stated  that  provide  further  details  regarding  geometric 
and  graph  theoretic  properties  of  the  augmented  potential  function.  This  led  to  explanation  of  the  existence  of  a  spa¬ 
tial  order  in  flocks  and  self-assembly  of  connected  networks  of  agents.  Using  stress  elements  of  nets,  we  demonstrated 
that  the  (a,  a)  flocking  protocol  (or  Algorithm  1)  encompasses  all  three  rules  of  Reynolds. 

For  flocking  with  obstacle  avoidance,  each  obstacle  in  the  neighborhood  of  an  a-agent  was  represented  using 
a  f3- agent.  A  collective  potential  was  constructed  by  taking  into  account  the  interactions  of  all  three  species  of 
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Figure  17:  The  squeezing  maneuver  for  n  =  150  agents. 


agents.  Algorithm  3  was  derived  from  this  multi-species  collective  potential  function.  Both  split/rejoin  maneuver 
and  squeezing  maneuver  were  successfully  performed  using  Algorithm  3. 

We  established  that  the  architecture  necessary  for  implementation  of  Algorithm  3  is  a  peer-to-peer  network 
of  macro-agents.  The  biological  implication  of  this  peer-to-peer  architecture  is  that  “flocks  need  no  leaders”.  A 
“universal”  definition  of  flocking,  called  a-flocking,  was  provided  and  a  procedure  for  verification  of  a-flocking  was 
introduced.  This  definition  is  objective  and  does  not  depend  on  a  particular  method  used  for  generation  of  the 
trajectories  of  particles. 
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Appendix 

A  Proofs  of  Some  Results 

A.l  Proof  of  Lemma  2 

By  definition,  qc  =  pc  and  x  =  v.  Given  protocol  (26),  we  have 

q  =  -VV(q)  -  L(q)p  +  /7(<?,p,  gr,pr). 
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Figure  18:  The  C,R,E,K  curves  for  simulations  in  Fig.  11  and  Fig.  12:  (a)  flocking  and  (b)  regular  fragmentation. 


Due  to  the  fact  that  G(q)  is  an  undirected  graph,  Ave(VP(#))  =  0  for  all  q.  Similarly,  we  get  A ve(fd(q))  = 
A ve(L(q)p)  =  0  for  all  q,p.  Assume  /-,(<?,  p)  is  a  linear  controller  in  the  form 

f-y{q,P,qr,Pr)  =  ~Cl(q  ~  1„  ®  qr)  -  C2{p  ~  1„  <S>  Pr) 

with  ln  =  col(l, . . . ,  1)  €  R".  Then,  fj(q,p)  can  be  decomposed  into  two  terms: 

f'y(q,P,Qr,Pr)  =  “Cl  {x  +  ln  <E»  qc  ~  1„  <8  qr)  -  C2(v  +  ln  0  Pc  -  ln  ®  Pr) 

=  -ax  -  c2v  -  Ci(l„  ®  (qc  -  qr ))  -  c2(l„  ®  (pc  -  Pr)) 

=  g(x,v)  +  1„  ®  h(qc,pc,qr,pr) 

where  g(x,v)  and  h(qc,pc,qr,pr)  are  defined  in  (35).  Note  that  Ave(a;)  =  Ave(u)  =  0  and  thus  A ve(g(x,v))  =  0. 
The  translational  dynamics  can  be  obtained  as  follows 

qc  =  A ve(f^(q,p,qr,pr))  =  Ave(g(x,v))  +  Ave(ln  ®  h(qc,pc,qr,pr))  =  h(qc,pc,qr,pr). 

On  the  other  hand,  x  =  q  —  ln  ®  qc  and  this  gives 

x  =  -W(<?)  -  L(q)p+  f7(q,p,  qr,pr)  ~  In  ®  h(qc,pCl  qr,pr) 

=  -W (q)  -  L(q)p  +  g(x,v). 

But  Xj  —  Xi  =  qj  —  qi  for  all  edges  (i,j)  €  £(q)  which  means  VV(q)  =  VV(x)  and  aij(q)  =  dij{x)  for  all  edges  (i,j). 
Thus,  L{q)  =  L{x)  for  all  q.  The  first  two  terms  of  the  expression  for  —x  can  be  rewritten  as 

X7V(q)  +  L(q)p  =  W(x)  +  L{x){v  +  1„  ®  pc) 

=  VV(x)  +  L{x)v 

This  is  because  any  m-dimensional  graph  Laplacian  W  =  W  ®  Im  satisfies  W( ln  0  y)  =  0  for  all  m- vectors  y. 

A. 2  Proof  of  Theorem  5 

We  prove  parts  i),  ii),  and  iii)  as  three  separate  claims  under  the  following  assumption: 

Assumption  1.  Assume  q  is  an  a-lattice  with  scale  d  >  0  and  ratio  n  >  1  that  is  collision-free  in  dimension  m  (i.e. 
no  two  nodes  coincide). 
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Claim  1.  Let  q  be  an  a-lattice  satisfying  Assumption  1  for  m  =  2,3.  Then,  the  framenet  induced  by  this  a-lattice 
is  a  planar  graph. 

Proof.  The  proof  follows  from  elementary  geometric  arguments,  yet  it  is  nontrivial.  Let  ( A ,  B )  and  ( C ,  D)  be  two 
edges  of  a  framenet  ( G(q),q )  induced  by  an  a-lattice  q  of  scale  d  and  ratio  k  =  r/d  >  1.  Suppose  that  the  partial 
lines  AB  and  CD  that  satisfy  AB  =  CD  =  d  intersect  at  point  P  which  is  distinct  from  points  A,  B,  C ,  D  (See 
Fig.  19(a)).  In  three  steps,  we  demonstrate  that  one  reaches  a  contradiction. 

Step  1:  Assume  ( A ,  C),  (B,  C),  (A,  D),  ( B ,  D)  £(q).  Without  loss  of  generality,  let 

PB  =  min  {PB,  PA},  PC  =  min  {PC,  PD}, 

Thus,  AB  >  2 PB  and  CD  >  2 PC.  We  have 


PB  <  d/2,  PC  <  d/2  ==>  BC  <  PB  +  PC  =  d  <r 

Hence,  B  and  C  are  neighbors  and  BC  =  d  (because  q  is  an  a-lattice).  This  only  contradicts  ( B ,  C )  ^  £(q)  and  the 
rest  of  the  assumptions  still  hold. 

Step  2:  From  step  1,  we  have  AB  =  BC  =  CD  =  d  (see  Fig.  19(b)).  Assume  A,C  and  B,D  are  not  neighbors. 


(a) 


(c) 


Figure  19:  (a)  two  partial  lines  of  equal  length  intersecting  at  P,  (b)  the  edges  {A,  B ),  ( B ,  C),  ( C ,  D)  of  equal  length, 
and  (c)  an  equilateral  triangle  ABC  and  a  node  D  on  the  arc  AB. 


Draw  two  circles  of  radii  d  centered  at  points  B  and  C.  These  circles  intersect  each  other  at  F  and  A FBC  is 
an  equilateral  triangle.  Points  A  and  D  are  located  on  the  circles  centered  at  B  and  C,  respectively,  as  shown  in 
Fig.  19(b).  Suppose  A  is  not  located  on  the  arc  FC  and  D  is  not  located  on  the  arc  FB.  Then,  AB  and  CD  never 
intersect  because  the  line  l,  passing  through  F  and  orthogonal  to  BC,  separates  them.  Unless,  AB  and  CD  meet  at 
P  =  A  =  D  which  contradicts  the  assumption  that  partial  lines  AB  and  CD  intersect  at  a  point  other  than  their 
endpoints.  Hence,  we  assume  A  is  located  on  the  arc  FC  (without  loss  of  generality).  Let  6  =  AABC,  then  6  <  tt/3. 
We  have 

AC  =  2dsin(0/2)  <  d  <  r, 

which  means  A,  C  are  neighbors  and  AC  =  d.  Therefore,  A  ABC  is  an  equilateral  triangle  and  A  and  F  coincide 
(otherwise,  if  A  and  mirror  image  of  F  w.r.t.  BC  coincide,  then  AB  and  CD  never  intersect).  Moreover,  if  D  is 
anywhere  but  on  the  arc  BF  =  BA,  AB  and  CD  do  not  intersect.  Hence,  A  ABC  is  an  equilateral  triangle  and  D 
is  on  the  arc  BA  (see  Fig.  19(c)). 

Step  3:  Draw  a  circle  of  radius  d  centered  at  C.  Clearly,  this  circle  passes  through  A  and  B.  Since  CD  intersects 
AB  at  P ,  the  continuation  of  the  partial  line  CP  intersects  the  arc  AB  at  point  D.  Set  <f  =  ADCB  and  if  =  ADC  A 
and  notice  that  0  <  <f>,  if  <  tt/3.  We  get 

AD  =  2dsin(i/>/2)  <  d  <  r. 

Similarly,  one  obtains  BD  <  r.  Hence,  A  DBA  is  an  equilateral  triangle  with  a  side  length  of  d.  In  other  words,  all 
four  node  A,B,C,D  are  mutually  neighbors  of  each  other  and  CD  =  \/3 d.  This  contradicts  the  assumption  that 
CD  =  d  and  the  result  follows  for  dimension  m  =  2.  The  proof  for  dimension  in  =  3  reduces  to  the  preceding  proof, 
once  one  passes  a  2-D  plane  7r  through  the  intersection  point  P  with  a  surface  normal  of  AB  x  CD.  □ 
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Claim  2.  Suppose  Assumption  1  holds.  Then,  the  net  G(q)  induced  by  an  a-lattice  at  most  has  3 n  —  6  links  (or 
undirected  edges). 

Proof.  This  is  a  well-known  fact  in  graph  theory  based  on  Euler’s  formula  that  any  planar  graph  at  most  has  3?i  —  6 
undirected  edges  [2,  7].  □ 

Claim  3.  Suppose  Assumption  1  holds.  Then,  the  net  G(q)  with  n  >  m  +  1  nodes  is  not  a  complete  graph  in 
dimensions  m  =  1,  2, 3. 

Proof.  The  proof  is  trivial  for  dimension  1.  Thus,  we  first  prove  the  statement  for  dimension  2.  Suppose  G(q)  is  a 
complete  graph  with  at  least  4  nodes.  Let  H(q)  be  the  subgraph  of  G(q)  induced  by  the  set  of  vertices  £4  =  {1,  2,  3, 4} 
(i.e.  the  set  of  all  edges  of  G(q)  with  both  of  their  endpoints  in  ITf).  Then,  H(q)  =  K4  is  a  complete  graph  and 
all  nodes  of  H(q)  are  neighbors  of  each  other.  This  means  that  nodes  1,2,3  together  make  an  equilateral  triangle 
T  =  A123  with  a  side  length  of  d.  There  are  two  scenarios:  i)  node  j  =  4  is  inside  triangle  T  including  its  boundaries 
and  ii)  node  j  =  4  is  outside  T.  In  case  i),  the  distance  between  j  and  at  least  one  of  the  three  other  vertices  is 
less  than  d.  According  to  the  second  scenario,  j  is  outside  of  T  and  within  a  distance  d  from  all  vertices  of  T.  In 
particular,  j  is  within  a  distance  d  from  nodes  1,2.  Let  h  =  \/3d/2  be  the  height  of  an  equilateral  triangle  with  a 
side  length  of  d.  Then,  the  distance  between  j  and  node  3  is  either  zero,  or  2 h  >  d.  In  either  case,  j  cannot  be 
equally  distanced  from  all  vertices  of  T.  Thus,  H(q)  cannot  be  a  complete  graph.  This  is  a  contradiction  and  the 
result  follows  for  dimension  2. 

The  proof  for  dimension  m  =  3  is  very  similar  and  the  complete  proof  is  omitted.  Here  is  a  sketch  of  the  proof: 
G(q)  is  a  net  with  at  least  n  =  5  nodes  and  H(q)  is  a  subgraph  of  G{q)  induced  by  the  set  of  nodes  U5  =  {1,  2, 3, 4, 5}. 
Moreover,  the  triangle  T  is  replaced  by  an  equilateral  tetrahedron  (or  pyramid)  V  on  four  vertices  1,2,  3,4.  Node 
j  =  5  is  either  inside  V,  or  outside  V.  In  both  cases,  j  cannot  be  within  a  distance  d  from  all  the  vertices  of  the 
pyramid  V.  For  an  equilateral  tetrahedron,  the  height  satisfies  h  =  \/6d/3  and  2 h  >  d.  □ 


B  Nonlinear  Navigational  Feedback:  Coupled  Normal  Forms 


Let  fj(q,p,  qr,Pr)  be  a  nonlinear  navigational  feedback  and  define  ho(q,p,  qr,pr )  =  Ave(f7(q,p,  qr,pr ))  and  go(q,p,  qr,Pr ) 
f-y(q,P,qr,Pr)  -  1  n  ®  h0(q,  p,  qr,  pr) .  Notice  that  Ave(g0(q,p,  qr,Pr))  =  0,  for  all  q,p,qr,pr.  Then,  we  have 

fy(,QiP:  Qn  Pr)  =  So  (<7,  P,  dr ,  Pr)  +  ln  ®  4)(<b  P.  dr ,  Pr)  ■ 

Define  the  maps  g\ ,  hi  as 

gi(x,v,qc,pciqr,pr)  :=  g0(x  +  ln  <8>  qc,  v  +  1„  <8>  pc,  qr,pr) 
hi{x,v,qc,pciqr,pr )  :=  h0{x  +  ln  <8>  qc,  v  +  ln  ®  pc,  qr,pr) 

Then,  the  normal  forms  of  structural  and  translational  dynamics  are  no  longer  decoupled  and  can  be  expressed  as 


(80) 

(81) 


J  X  =  V 

\  i>  =  -W(a’)  -  L(x)v  + gi(x,v,qc,pc,qr,pr) 


(82) 


and 


dc  =  Pc 

pc  =  hi(x,v,qc,pc,qr,pr) 


(83) 


This  demonstrates  that  the  decomposition  of  structural  and  translational  dynamics  is  solely  due  to  linearity  of 
the  navigational  feedback.  Clearly,  the  stability  analysis  of  the  coupled  normal  forms  of  structural  and  translational 
dynamics  is  more  challenging  than  the  decoupled  version  of  the  normal  forms.  An  example  of  a  nonlinear  navigational 
controller  is  the  following  uniformly  bounded  feedback 


fi(Qi,Pi,Qr,Pr)  =  — sat(ci(g.j  -  qr)  +  c2(pi  -  pr)),  <h,c2  >  0. 


(84) 


To  implement  this  feedback,  each  agent  needs  to  know  its  own  state  and  the  state  of  its  7-agent,  thus  the  feedback 
in  (84)  is  a  distributed  navigational  feedback.  The  map  sat(-)  is  an  m-dimensional  saturation  function  given  by 


sat (z) 


z,  INI  <  1, 
*/INI.  INI  >  !■ 


(85) 
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Even  for  the  case  of  n  =  2  agents,  ho(q,p,qr,pr)  =  A ve(f*y(q,p,qr,Pr))  depends  on  both  (x,v)  and  (qc,pc).  Notice 
that  for  any  choice  of  ci,  C2  >  0,  there  exists  a  local  neighborhood  Mun  of  (ln  ®  qr,  1  n®pr)  in  Rm?l  x  such  that 

I \ci(qi  -  qr)  +  c2 (pi  Pr)  II  <  1,  Vi,V(g,p)  G  MUn 

and  f-y(q,p,qr,Pr)  acts  as  a  linear  controller.  Thus,  as  long  as  the  center  of  group  is  near  ( qr,Pr ),  the  structural 
dynamics  and  navigational  dynamics  are  decoupled  with  the  controller  in  (84). 
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